Generating Fake Conversations by fine-tunning OpenAI’s GPT-2 on data from Facebook Messenger | Svilen Todorov
One of the most interesting problems in NLP has always been human-like conversation and many are still considering passing the Turing Test as the holy grail of the field. In this post, I show how to use a state of the art model on your own data (I use my own messages sent on facebook) to generate (somewhat) realistic conversations.
One of the most interesting problems in NLP has always been human-like conversation and many are still considering passing the Turing Test as the holy grail of the field. In this post, I show how to use a state of the art model on your own data (I use my own messages sent on facebook) to generate (somewhat) realistic conversations. In February 2019 OpenAI released information on their new state of the art language model which created a lot of buzz within the community. While few disagree the results they included are better than anything we’ve seen before (even if mainly because they made a bi
related reading
- The case against conversational interfaces << julian.digitaljulian.digital
- Let's build GPT: from scratch, in code, spelled out.youtube.com
- GitHub - brexhq/prompt-engineering: Tips and tricks for working with Large Language Models like OpenAI's GPT-4.github.com
- microgptkarpathy.github.io
- Let's reproduce GPT-2 (124M)youtube.com
- GPT in 60 Lines of NumPy | Jay Modyjaykmody.com
- Synthetic data generation (Part 1)cookbook.openai.com
- Deep Dive into LLMs like ChatGPTyoutube.com
- Self-Fulfilling Misalignment Data Might Be Poisoning Our AI Modelsturntrout.com
- [2203.02155] Training language models to follow instructions with human feedbackarxiv.org
- Offline RL and Large Language Models - by Sergey Levinesergeylevine.substack.com
- [2210.13382] Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Taskarxiv.org