For SQl Server, you can remove the BuildIn/Administrator role (before removing it make sure you add your windows user as a Sysadmin). That means not every administrator can log on to the system. You can add each of these users individually and give them the rights they require just like you give rights to any normal user.
For Windows, You should take a look at the Local Policy. I think you can set up users in such a way that they can do the required job without being the local admin or Domain admin. But dont quote me on that. 😉