View Issue Details

IDProjectCategoryView StatusLast Update
0015518MMW 5DB / Backuppublic2019-09-19 10:31
Reporterpeke Assigned To 
PriorityurgentSeveritymajorReproducibilityalways
Status closedResolutionfixed 
Target Version5.0Fixed in Version5.0 
Summary0015518: Rebuild DB do not create complete DB location browsing is missing paths
DescriptionAfter upgrade from MM4 to MM5 and rebuilding DB. Rebuilt DB still miss number of Albums in search and in Location browsing.

Only way to find those files in search is to use Path/Filename search targeting specific missing tracks.

Add/scan missing paths do not re-add them as tehy are as expected already in library.

User MM.DB from MM4, rebuilt DB in MM5 and Images from MM4 search are uploaded onto FTP. NOTE same behavior is observed in MM5 using rebuilt DB

In several remote sessions we tried to get MM.DB fully working even thru upgrading to MM5 and Expected behavior was that MM5 resolve issues with DB.
Additional InformationHPE-964-77180
TagsNo tags attached.
Fixed in build2166

Relationships

related to 0015528 closedLudek Paths from inaccessible media starts with '?' 
related to 0015527 closedLudek MM4 > MM5 upgrade never finishes on some corrupted databases 
related to 0015956 closedLudek Script "Show all nodes" sometimes does not show subnodes and tracks of Album Artist 

Activities

Ludek

2019-03-01 10:13

developer   ~0052847

Peke re "Rebuilt DB still miss number of Albums in search and in Location browsing"

Can you be more concrete, which albums in which search? And which location browsing?
A concrete example with screenshots would be very helpful.

peke

2019-03-01 12:41

developer   ~0052848

Last edited: 2019-03-01 13:14

I'll use MM4 in as it is easier to show what is going on and it is easy to replicate on both original and rebuilt DB (MM4 compatibility was enabled).
1. Snap9 -> Navigate using Entire Library -> Location -> HD: Seagate (F: for user) -> Music -> Various Artists -> The complete Stax-Volt ...
2. Snap10 -> Folders "The Contemporary Records Story [Disk 1]" -> is missing Even It exist on users HDD (Explorer window) and is added to library
3. Snap11 -> Initiate Advanced Search on Entire library -> Path/Filename Contains "The Contemporary Records Story", Sort Path A..Z
4. Snap12 -> Search result show that tracks are in Library and found -> containing tracks from "Benny Golson" and "Benny Carter"
4a. Snap12 -> If you right click on any track from result -> FMFS -> Folder (Library) it fails
5. Snap13 -> Search result shows track "Whisper not" by "Benny Golson"
    a. Start advanced search for Artist & Album artist "Benny Golson"
    b. Start advanced search for Artist "Benny Golson", extension WAV
    c. Start advanced search for Any text Field "Benny Golson", extension WAV
    NO RESULTS FOUND on all searches containing tracks that are at path "The Contemporary Records Story [Disk 2]"
6. Snap14 -> Even starting search for WAV and Artist "Benny" (WAV is optional but then it is clear in results) -> Do not show any tracks from "Benny Golson" and also no track "Old Fashioned Love" by "Benny Carter"

NOTE user heavily depends on hers playlists as they are used in hers radio show so resetting DB is not an option, we tried and tracks show then correctly.

Ludek

2019-03-01 16:14

developer   ~0052850

Last edited: 2019-03-01 17:13

I cannot replicate this step 4 (snap12) -- in my case the search results shows just nothing (tested both DB versions), even searching just for 'The Contemporary' does not show the tracks:
https://www.dropbox.com/s/tupaby0s0yfu6h1/Screenshot%202019-03-01%2017.12.31.png?dl=0

And by analyzing in SQLite studio the songs are not in DB at all !!!:
https://www.dropbox.com/s/sotmrlr9visbisx/Screenshot%202019-03-01%2017.22.57.png?dl=0

So it looks that the songs were somehow removed from the DB?
Could the user had some scripts installed -- that would remove the songs from the DB ?

Try to get the original user DB (with the mentioned songs included within the DB).

peke

2019-03-02 22:26

developer   ~0052858

Last edited: 2019-03-02 22:26

Uploaded new MM.DB after doing maintain Full optimize, along with DB I created LOG File and Video File of that LOG file.

NOW DB convert Never Finish Update in MM5 2164 (LOG Uploaded)

Ludek

2019-03-05 21:33

developer   ~0052875

Last edited: 2019-03-05 21:41

I analyzed the DB.
Now, it is the right MM.DB (user has custom DB path -- F:\MediaMonkey\MM.DB) including the "missing tracks" playlist and the problematic tracks.
Actually there are 13277 tracks that has Songs.IDFolder = '' in the database. This is integer field and is always filled by an integer value in MM4.
So there was most probably a third party app involved (an addon or SQLite editor) that changed the IDFolder integer value to empty string for the affected tracks.

As Peke pointed, this is fixable by using 'Rebuild database' in MM5, but it cannot be done, because the MM4 > MM5 db upgrade process never finishes on this database: 0015527

Ludek

2019-03-05 22:09

developer   ~0052876

Last edited: 2019-03-05 22:11

Once I was able to go over 0015527 (to be fixed as 0015527 in the next build)
then I used "Rebuild database" option in MM5 and the MM.DB was correctly re-created with correct folders, see:
https://www.dropbox.com/s/6mq8y7k5rgaow44/Screenshot%202019-03-05%2023.03.10.png?dl=0

The rebuilt database is here: https://www.dropbox.com/s/5qrask0movrux9r/MM.zip?dl=0
It was rebuilt with the MM4 compatibility mode, so let's post it to the user and resolve this issue.

Ludek

2019-03-06 10:46

developer   ~0052888

Last edited: 2019-03-06 21:45

The repaired database has been sent to the user via ticket HPE-964-77180
During testing this I have found another issue: 0015528

The question is what caused the DB corruption, note that during fixing of 0015527 the DB was found as missing all indexes and all triggers!
Something had to clear all database indexes and triggers. It is not first time I saw this, the similar happened in HLF-979-2701

@Peke: Could you please compare set of used addons of user HPE-964-77180 with set of used addons of user HLF-979-2701
This way we could find an addon that is common to both users (and is causing the triggers & indexes removal) ?

peke

2019-03-06 21:50

developer   ~0052895

Last edited: 2019-03-07 01:37

Reopen. Looks like rebuild didn't fixed Extensions Index.

Same Library:
- Advanced Search ALL for: Ext = WAV + Artist Contain "Golson", Sort Path A..Z fail to find any
- Advanced Search ALL for: Artist Contain "Golson", Sort Path A..Z (EXTENSION is not Available) Find Golson and After Manually Sort Extension it shows tracks by "Benny Golson"

New Video sent to Ludek directly.

User do not have any plugin installed, but she may tried few in past. quote "Possibly Backup script"

Ludek

2019-03-07 21:28

developer   ~0052901

Last edited: 2019-03-07 22:11

Yes, this was consequence of the missing 'insert_songs' database trigger that fills Songs.Extension field when inserting song into database.

=> Fixed in 2166 (i.e. rebuild database feature in MM5 fixes the issue)

peke

2019-04-17 00:16

developer   ~0053272

Verified 2170

User also confirmed that rebuild worked flawlessly on hers DB.