osticket does not support mssql at this time. So you would probably want to ask in the mods area for someone to mod the project to work with mssql.
It runs under IIS just fine though. I'm running two different implementations under IIS with PHP and MySQL.