Sketching out rough ideas—traditionally on the back of a napkin in the US, backs of envelopes being preferred in the UK—is a common and important part of the design process, with the familiar pen or pencil and paper being favored for rough mockups and outlines. Ink to Code, a new Microsoft Garage project, hopes to turn those rough sketches into usable, working code.
Ink to Code is currently itself a rough prototype of an app. The basic premise is simple: designers can sketch out the bare bones of application interfaces with a stylus, and Ink to Code will turn those sketches into real code, specifically the XML markup used for Universal Windows Platform apps and Xamarin apps for Android. It uses the Windows 10 Ink APIs to recognize the objects that have been drawn, converting handwriting into text and boxes into screens, buttons, text boxes, and image placeholders.
Currently, the app is only an early prototype—a basic proof of concept rather than a fully fledged development tool. It recognizes only a few interface elements, along with rules and guidelines for aligning things, and it produces only basic code with no functional parts. The company has various ideas of how to develop it further but wants to hear from real designers and developers where to focus its development efforts. Some obvious directions are supporting a greater range of interface elements and producing more functional code; one can easily imagine how it could, for example, identify login screens and automatically plumb in authentication workflows.
Source:: Arstechnica – Gadgets