they were doing there were a dozen companies trying something new that may or may not work,

I'd like some samples of that. A company attempting something transformative back then that may or may not work that didn't work. I was working for a company that hooked 'promising' companies up with investors, no shit, that was our whole business plan, we redress your site in flash, put some video/sound effects in, and help sell you to someone with money looking to buy into the next google . Everything that was 'throwing things at the wall to see what sticks' was a thinly veiled grift for VC. Almost no one was doing anything transformative. The few things that made it (ebay, google, amazon) were using engineers to solve actual problems. Online shopping, Online Auction, Natural language search. These are the same kinds of companies that continue to spring into existence after the crash.

It's the whole point of the bubble. It was a bubble because most of the money was going into pockets not making anything. People were investing in companies that didn't have a viable product and had no intention south of getting bought by a big dog and making a quick buck. There weren't all of a sudden this flood of inventors making new and wonderful things unless you count new and amazing marketing cons.