I am very sorry to hear what happened.
This is 100% a scam. This person was not working for Microsoft and Microsoft would never call you for no reason.
This is what is known as "phone phishing" it is can be a very serious problem if you do let them access your computer.
Basically what they will do is call a lot of phone numbers and say that you have problems. Any actual computer problems you have will be entirely coincidental. Usually what they will do is show you the windows error log which always shows a lot of errors but these are normal and on all windows computers, they are not viruses.
Next they log onto your computer and lie to you about the numerous problems they pretend to find. Next they will attempt to get you to pay a few hundred dollars to "fix" the issues when in fact they actually do nothing.
Sometimes they lock people out of their systems and steal their credit cards as well.
Here is what Microsoft says on the subject:
Always remember, no legitimate tech support company would ever call you. Your computer does not report to Microsoft or any other company so if any tech support person calls you can trust it is a scam and just hang up.
I suggest you contact your bank immediately and tell them you have been a victim of fraud and try to get your money back. If "Steve" does call you again just hang up immediately.
He was most likely located in India and because of this there is little the authorities can do to prosecute. This is a very well known scam and many have fallen victim to it. Here is another article about these types of scams http://www.pcadvisor.co.uk/how-to/security/microsoft-phone-scam-dont-be-victim-tech-support-call-3378798/
Please take a moment to click the stars above, 3 or more please to acknowledge you have received my answer and advice. You may still reply to me if you have follow up questions or need more help.