26
Searching through massive files
(lemmy.world)
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 06 Jul 2025
26 points (96.4% liked)
Selfhosted
53973 readers
41 users here now
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
-
Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
-
No spam posting.
-
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
-
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
-
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
-
No trolling.
-
No low-effort posts. This is subjective and will largely be determined by the community member reports.
Resources:
- selfh.st Newsletter and index of selfhosted software and apps
- awesome-selfhosted software
- awesome-sysadmin resources
- Self-Hosted Podcast from Jupiter Broadcasting
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
founded 2 years ago
MODERATORS
RDBMS shines on getbyId queries. Queries where the value starts with should also work well. But queries where the word is in the middle of the value or column generally don't perform well. Since it's just for personal use that might not matter too much. If you're querying on exact values it'll go pretty smooth. If you're querying on 'deniro' while the value contains 'bob deniro' and others it'll be less performant. But it's possible it works well enough for your case.
Elasticsearch is well known for text searches and being incredibly flexible with queries and filtering. https://www.elastic.co/
Manticore is one that's been on my check-it-out for I don't know how long. It looks great imo: https://manticoresearch.com/
Open search: https://opensearch.org/
Disclaimer: I haven't really used any RDBMS systems extensively for years so it's possible there are some that added support for full text searches being more performant.
Aleph also seems to be able to cross reference data between documents. I don't think any of the ones listed above do this. But I also don't know if this is part of your requirements.