You are not wrong, but I think public perception is different. It doesn’t help, that OpenAI is pushing their models as problem solvers:

GPT-4 can solve difficult problems with greater accuracy, thanks to its broader general knowledge and problem solving abilities. (https://openai.com/gpt-4)

I think a lot of things that are proposed here could not be done by an AGI on an computer, no matter how intelligent. Consider this alternative scenario: You have an exceptionally intelligent young human adult with a computer locked in a room. They have no specialized education or anything. They are just extremely intelligent. What could you achieve through such a person?

Discovery of new physics is out of the question. That would need experiments.