Voodoosketch is a system that extends interactive surfaces with physical interface palettes on which users can dynamically deploy controls as shortcut to application functionality. The system provides physical ‘plug and play’ controls as well as support for sketching of controls, and allows controls to be associated with application functions via handwritten labels. The system uses a special digital pen, which writes ‘real’ ink on the palettes while functioning as a digital input device on the interactive surfaces. The palettes can be seamlessly integrated into existing applications, be appropriated by the user to suit different input requirements, and support new interaction styles across multiple surfaces, palettes and users.