Just to put my two cents in:
what if you keep all Child- Item data in memory and insert the childs when the user expands a certain parent Item. You could allow to expand 4 parent items at maximum. On my computer it took for the first four Items 36, 20, 34, 60 ms.
Greets, Dave