ScreenPilot
MCP server to let LLM take full control on your device by providing screen automation toolkit for controlling and interacting with graphical user interfaces. Good for automation, education and having fun.
Main Features
- 📷 Screen capture and analysis
- 🖱️ Mouse control (clicking, positioning)
- ⌨️ Keyboard input (typing, key presses, hotkeys)
watch demo
https://github.com/user-attachments/assets/c18380c0-b3dd-4b7c-925d-28ef205ca11f
Installation
- Install python 3.12
- Clone the repository:
git clone https://github.com/Mtehabsim/ScreenPilot.git - create virtiual environment
python -m venv venv- activate the env
venv\Scripts\activate- Install the required packages:
pip install -r requirements.txt - Open Claude AI desktop
- file -> settings -> developer -> edit config
- open config file and paste this
{
"mcpServers": {
"device-controll": {
"command": "pathToEnv\\venv\\Scripts\\python.exe",
"args": [
"pathToProject\\ScreenPilot\\main.py"
]
}
}
}
