The study providesa man-machine multi-modal early intervention training method to improve autisticchildren social interactive ability by establishing an interactive multi-modal intelligentlearning environment.The learningenvironment includes 6 modules such as visual signal processing, speech signalprocessing, the physical interface, multi-modal integration, intelligentconsole and real scene simulation.In the learningenvironment, children directly interact with the learning environment throughthe front-end module and the back-end module produces interactive virtual scenebased on the children’s behaviors.The learning environment simulates real scenewhere children express interests in things through speaking and watching.

The systematic design of the learning environment Multi-modal human machine interactivelearning environment