Calisto (Collaborative Assistant for Live Semantic Interactions with Tangible Object) is a new multimodal semantic based dialogue system. Natural language and gesture interaction with a touch terminal or smartphone offer simplified, exciting and unexpected possibilities to explore knowledge databases. Comprehensive information linked to a specific domain can be made available very intuitively. Through an intelligent sharing system, it is also possible to share information between two mobile phones.