Oh for sure, it's not perfect, and IMO this is where the current improvements and research are going. If you're relying on a LLM to hit hundreds of endpoints with complex contracts it's going to either hallucinate what it needs to do, or it's going to call several and go down the wrong path. I would imagine that most systems do this in a very closed way anyway, and will only show you what they want to show you. Logically speaking, for questions like "should I wear a coat today" they'll need a service to check the weather in your location, and a service to get information about the user and their location.