Distillation will allow complex models to run in production by lowering their size and latency, when holding the majority of the performance of more substantial, far more computationally expensive models. It's been utilised to boost Google Research and Smart Summary for Gmail, Chat, Docs, and much more.Google provides Sequence To Sequence Learning