I disagree about cricket - it would be big in India/Pakistan, but wouldn't make much of a dent anywhere else - the US wouldn't care, South America would mostly not care, China/Japan wouldn't care. Aus/UK would just view it as another version, and it takes too long for ease of broadcasting.
Cricket has a big team from every continent other than South America.
Baseball, softball etc don't have that sort of worldwide appeal and they're in the Olympics.
The games are only like 3 hours long as well but you might have a point there. I'm struggling to think of any other sports in the Olympics that take that long with multiple events.
If the compromise is T10 cricket then I would rather it not be in the Olympics, as that is just terrible to be honest.