I'd say that if the Avalon is conventional non hybrid, then you can probably both reduce and re-route IAC air. The Insight is a new "insight" to doing the IAC mod when it is a hybrid. I'm guessing the car can run on battery, while the engine acts as a generator for the battery bank. I haven't done a hybrid yet. But your experience w/ it shows the need for further understanding of the strategy these hybrids use. It sounds like the engine needs substantial airflow, with the throttle mostly or completely closed.
But I think, correct me if I'm wrong, the Toyota Avalon is a conventional gas engine, so conventional IAC mod strategy should be Ok. I've seen pics of lots of TB's that have that center wall, and IAC air goes in around both sides of wall. Your Insight just happens to have that center IAC air wall. Turned out yours didn't respond as could be expected, 'cause it's a Hybrid, that's all, far as I can tell. Honda is famous for putting leading edge stuff in their cars, ever since ever since. I'd expect the Avalon to be much more straightforward. Just do it, you have great technique, Joseph.
Tracy G