WIP: New scanner

[deluan]

⚠️ This is very experimental code and will break your DB if you run it locally! If you want to try it for any reason, be sure to backup your DB first! ⚠️

This is the branch/PR that holds the new Scanner implementation. Goals for this new scanner:

• Be faster :)
• Import all tags from audio files to the DB, including multi-valued tags, making them available for smart playlists
• Import multiple artists and artist roles
  • Import all artists found in tracks, and make them browseable/searchable/filterable #211
  • Support multiple artists, with custom separator #238
  • Create artist objects for Artists without albums #2583
  • add support for Composer #275
  • Add support for Remixer #277
  • Add support for Conductor #281
  • Add support for Lyricist #276
• Handle artist/album disambiguation - Navidrome shows different versions of the same album in one list #1976 (comment)
• Handle library/files moves/renames - Ability to change file path for a song without clearing user information (rating, favorite, plays, etc) #2068
• Prepare to handle multiple libraries (even though this feature will come later) - Multiple Music Folders #192
• Support non-numeric Track and Disc "numbers" (Ex: A1, A2 for vinyl) - Support for non-numeric tracknumbers tags #1652
• Resumable full scans - Resume library scan in event of blackout #1418
• Use fsnotify to detect changes in the FS and trigger scans only on the modified folders
• Better .ndignore support - Allowing a syntax like .gitignore inside the .ndignore`. #1394
• Use fs.FS if possible - Add API to replace FS access #832
• Potentially run a DB VACUMM at the end of a full scan (discussion in Discord)

[github-actions]

Download the artifacts for this pull request:

• js-bundle.zip
• binaries.zip

[tty228]

INFO[0127] Scanner: Starting scan                        fullRescan=true numLibraries=1
DEBU[0127] Scanner: Found folder                         _path=/home/****/GitHub/navidrome/music/1 audioCount=1 folder=1 hasPlaylist=false images="[]"
DEBU[0127] Scanner: Found folder                         _path=/home/****/GitHub/navidrome/music audioCount=4 folder=music hasPlaylist=false images="[]"
DEBU[0127] Scanner: Found folder                         _path=/home/****/GitHub/navidrome/music/2 audioCount=1 folder=2 hasPlaylist=false images="[]"
INFO[0127] Scanner: Finished scanning all libraries      duration="713.296µs"

I attempted to scan songs, and the logs indicate that music files were found, but the song list is not displayed in the UI.

Version
0.50.1-SNAPSHOT (e8adcda) from https://github.com/navidrome/navidrome/actions/runs/7281968279

How Navidrome is installed?
navidrome_linux_amd64_linux_amd64_v1

Environment

• OS: pre-built binary (ubuntu-22.04.3)
• Browser: Firefox
• Client: Web interface

[deluan]

Hey @tty228, thanks for trying it out, but... WIP = Work In Progress 🙃

The work is far from being in a usable state. I created this branch to have a docker image available for my own tests. When it is usable, I'll change the description and will ask feedback in our Discord dev channel.

[tty228]

Thank you for your reply. I was just curious and gave it a try. I mistakenly thought this was a version that required testing and feedback. 😆