Why DIY data collection should come before automation
If you’re getting started on your data journey, there’s no substitute for the personal touch


Data has been described as everything from the new gold, to the new oil - but really, it’s much more than that. Data has become more than just a valuable commodity, for many businesses, it’s essential for their very survival. However, immersing yourself in data carries its own risks.
For Or Lenchner, CEO of data collection platform Bright Data, many organisations make the mistake of trying to run before they can walk, gathering as much data as they can with little thought to what their actual needs are, and how they’re served by the data they’re gathering.
“Data isn’t the new gold,” says Lenchner, speaking on The IT Pro Podcast; “it's the new water. But you know, you can drown with too much water – so just take what you need. No more. You can always scale up in the future.”
The most valuable tip for businesses who want to experiment with data collection and analysis, he says, is to eschew fancy AI-powered tools altogether, and start with manual processes.
“There’s no replacement for just doing it yourself for the first time. You can throw terms like AI and ML into the air, and yeah, they'll handle it. But what the hell; I mean, you know what data you need. So just grab the data that you need, and later on scale up.”
Implementing mass-scale data collection, he said, is a waste of time and money if you don’t know what you’re looking for. When Lenchner started as a product manager, he said that his most valuable data came from simply calling customers and asking them a few basic questions.
“As a data company, it took us, like, four years to implement our first data warehouse,” he says, “not because we couldn't, but because we didn't want to; we had so much to do with the basic data that we collected internally.”
Get the ITPro daily newsletter
Sign up today and you will receive a free copy of our Future Focus 2025 report - the leading guidance on AI, cybersecurity and other IT challenges as per 700+ senior executives
“If you're doing a good job, you'll need to scale up to more places, gathering more data, which is great. Just, you know, start reasonably.”
Adam Shepherd has been a technology journalist since 2015, covering everything from cloud storage and security, to smartphones and servers. Over the course of his career, he’s seen the spread of 5G, the growing ubiquity of wireless devices, and the start of the connected revolution. He’s also been to more trade shows and technology conferences than he cares to count.
Adam is an avid follower of the latest hardware innovations, and he is never happier than when tinkering with complex network configurations, or exploring a new Linux distro. He was also previously a co-host on the ITPro Podcast, where he was often found ranting about his love of strange gadgets, his disdain for Windows Mobile, and everything in between.
You can find Adam tweeting about enterprise technology (or more often bad jokes) @AdamShepherUK.
-
Third time lucky? Microsoft finally begins roll-out of controversial Recall feature
News The Windows Recall feature has been plagued by setbacks and backlash from security professionals
By Emma Woollacott Published
-
The UK government wants quantum technology out of the lab and in the hands of enterprises
News The UK government has unveiled plans to invest £121 million in quantum computing projects in an effort to drive real-world applications and adoption rates.
By Emma Woollacott Published
-
Four-day weeks and Nadella's AGI skepticism
ITPro Podcast As the Microsoft chief casts doubt on ultra-advanced AI systems, a famous security blogger has fallen victim to a classic attack
By Rory Bathgate Published
-
Creating space for women in tech
ITPro Podcast Tech's huge gender divide can only be tackled with more welcoming, proactive sectoral efforts
By Rory Bathgate Published
-
Alteryx unveils double leadership appointment in fresh growth drive
News Alteryx has announced the appointments of Jon Pexton as chief financial officer and Steven Birdsall as chief revenue officer.
By Daniel Todd Published
-
Three-quarters of data analysts are still reliant on spreadsheets and manual preparation – but AI tools are now transforming the profession, boosting productivity, and supercharging efficiency
News Data analysts are still largely reliant on spreadsheets and manual preparation techniques, but AI and automation are shaking things up.
By Solomon Klappholz Published
-
What is the EU's AI plan?
ITPro Podcast As the EU moves to enable AI innovation, it could end up striking the perfect balance between regulation and public support – especially as US AI laws become more complex
By Rory Bathgate Published
-
The trends we’re watching in 2025
AI for security and sovereign cloud could be top driving forces in the coming year
By Jane McCallion Published
-
The 2024 that didn't happen
These are the megatrends of the year that failed to materialise
By Jane McCallion Published
-
What DORA means for business
ITPro Podcast Stringent requirements for third party monitoring and ongoing resilience testing could help put businesses on the best track for security
By Rory Bathgate Published