How do you plan to get this data? Most search companies don't share it.
Well, I've seen datasets from places like Common Crawl, Web Data Commons, Yahoo's Webscope which can be integrated into something like MeiliSearch. I'm going in kind of blind on this, and I don't know if it can be pulled off with the datasets that are publicly available. It's just something that has captured my imagination, and so I am on a fishing trip.
Your account is marked as a bot, you can change that toggle in your account settings
Weird. How about now? Thanks for the heads up.
Still marked as bot for me actually
How's that?
Apparently not good enough lol. Still marked as bot.
Dang it. I unticked the bot box, saved, still no joy.
I'm pretty much sure only free option for finding out what other people search for is Google Trends. It's very valuable data that is hard to get, so the companies that offer it charge quite a lot for it.
It's possible, but I can't find any existing solutions that solve this need.
The best possible data for this will come from the big search engine's APIs (e.g., Google, Bing) due their global reach and massive data storage capabilities.
If you truly want to self-host something, I'd suggest looking into setting up a simple pipeline from one of those (or multiple) APIs to a self-hosted data store (e.g., Elastic, Postgres) and write up some simple scripts that will let you search at-will like you would with Google Trends.
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
No spam posting.
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
No trolling.
No low-effort posts. This is subjective and will largely be determined by the community member reports.
Resources:
Any issues on the community? Report it using the report flag.
Questions? DM the mods!