Welcome to PyLips’s documentation!

PyLips is a Python-based interface for developing screen-based conversational agents. It is designed to make developing socially assistive robotics easier by providing a simple, expressive, and customizable framework for developing conversational agents.

PyLips is easy to install, simple to use, and open-source. It comes ready to use with your system’s speech synthesis tools, and uses other free and open-source software for turning these sounds into facial expressions. Check out the Usage section for installation instructions, or fork me on Github.

Note

This project is under active development. Please raise an issue on github if you are having any trouble!

Contents

• Usage
  • Installing PyLips
  • PyLips Quickstart
  • More Features of PyLips
    • Changing the Voice
      • Adding Voices on Mac
    • Changing the Face Appearance
    • Changing the TTS Backend
      • Integrating with Amazon Polly
    • Emoting with PyLips
    • Creating Multiple Faces
• Tutorials
  • Two Robots Talking
  • Follow with MediaPipe
    • Face Detection to X,Y,Z Coordinates
    • Exit Strategy
    • Drawing a Detection Box
    • Putting It All Together
  • Repeat After Me

API

• pylips.face
• pylips.speech
  • pylips.speech.RobotFace
  • pylips.speech.PollyTTS
  • pylips.speech.SystemTTS