Recently had a windows service that would not go away, did not find much documentation on this, so I am writing this for anyone else who is having similar issues.

Run with powershell as administrator.

Stop the service:

sc.exe stop service_name


Kill the service:

sc.exe delete service_name