How do I create Responsive single page application using Expression Engine

Even though it’s powerful I don’t think Experssionengine is meant to be for application development. It is possible but the added benefits are much less compared to using it for classic content management. What kind of application do you need? I mean that’s a broad definition. Your specs might just tell you if EE is the right tool.

Think of EE as your server side: database and scripting and add the front-end of your choice.

For responsive: you need a responsive front-end framework. If you are more into classic server side architectures then you can pick an html/css framework like Zurb Foundation or Bootstrap or similar. If you want to be trendy you can use EE to build only feeds and go with a javascript framework like React or Angular.