Facebook launches open-source bot training framework
ParlAI helps researchers train machines on key conversation tasks


Facebook has released an open-source framework that allows human tutors to teach AI chatbots how to have more natural conversations.
The company's artificial-intelligence research team, known as FAIR, has released the Python-based ParlAI tool, which gives researchers the ability to train bots over many different datasets at once, including benchmarking datasets like WebQuestions, WikiMovies and bAbl tasks.
Training is split into five tasks: general question answering; sentence completion, where the bot has to fill in the next word of a dialogue; back-and-forth chit-chat; visual dialogue with conversations involving images; and goal oriented dialogue, where a conversation is intended with a specific outcome.
"For the first time, ParlAI provides a place for researchers to collect all the significant dialog tasks in one place," wrote FAIR researchers Jason Weston, Alexander Miller and Will Feng in a blog post.
"Not only does this allow for much easier iteration on any of these tasks individually, but also makes it possible to easily train a bot on all of them (which eventually should lead to better bots) and to evaluate bots across all those skills."
The framework uses Amazon Mechanical Turk, a programme which uses low-paid human operators to do repetitive grunt-work that goes into training AI models, to improve the quality of AI conversations through question-and-answer sessions.
The release comes as part of the company's push into the AI space. The goal is to provide advertisers and brands with the ability to roll out natural-language chatbots on platforms like Facebook Messenger and WhatsApp, allowing customers to make enquiries, bookings and purchases just by talking to an AI helper.
Get the ITPro daily newsletter
Sign up today and you will receive a free copy of our Future Focus 2025 report - the leading guidance on AI, cybersecurity and other IT challenges as per 700+ senior executives
"ParlAI is a platform we hope will bring together the community of researchers working on AI agents that perform dialog," Facebook's researchers said, "and continue pushing the state of the art in dialog research."
Adam Shepherd has been a technology journalist since 2015, covering everything from cloud storage and security, to smartphones and servers. Over the course of his career, he’s seen the spread of 5G, the growing ubiquity of wireless devices, and the start of the connected revolution. He’s also been to more trade shows and technology conferences than he cares to count.
Adam is an avid follower of the latest hardware innovations, and he is never happier than when tinkering with complex network configurations, or exploring a new Linux distro. He was also previously a co-host on the ITPro Podcast, where he was often found ranting about his love of strange gadgets, his disdain for Windows Mobile, and everything in between.
You can find Adam tweeting about enterprise technology (or more often bad jokes) @AdamShepherUK.
-
Cleo attack victim list grows as Hertz confirms customer data stolen
News Hertz has confirmed it suffered a data breach as a result of the Cleo zero-day vulnerability in late 2024, with the car rental giant warning that customer data was stolen.
By Ross Kelly
-
Lateral moves in tech: Why leaders should support employee mobility
In-depth Encouraging staff to switch roles can have long-term benefits for skills in the tech sector
By Keri Allan
-
Meta to pay $725 million in Cambridge Analytica lawsuit settlement
News The settlement closes the long-running lawsuit into how Facebook's owner, Meta, handled the Cambridge Analytica scandal
By Ross Kelly
-
Meta's earnings are 'cause for concern' and 2023 looks even bleaker
Analysis Calls for investor faith in metaverse tech only emphasise the worries that its investment strategy won't pay off
By Rory Bathgate
-
Microsoft and Meta announce integration deal between Teams and Workplace
News Features from both business collaboration platforms will be available to users without having to switch apps
By Connor Jones
-
Facebook is shutting down its controversial facial recognition system
News The move will see more than a billion facial templates removed from Facebook's records amid a push for more private applications of the technology
By Connor Jones
-
'Changing name to Meat': Industry reacts to Facebook's Meta rebrand
News The rebrand attempts to provide a clearer distinction between Facebook and its umbrella company
By Connor Jones
-
Facebook's Oversight Board demands more transparency
News Board bashed the social media giant for its preferential treatment of certain high-profile accounts
By Danny Bradbury
-
Facebook claims AI managed to reduce hate speech by 50%
News The social media platform has hit back at claims the tech it uses to fight hate speech is inadequate
By Sabina Weston
-
Facebook to hire 10,000 workers across the EU
News The high-skilled jobs drive is a “vote of confidence” in the European tech industry
By Jane McCallion