NEWS

Data Independence Day – Make data great again

The fourth of July saw millions of Americans celebrating independence. Independence from the laws and regulations of Europe, the most recent being the EU General Data Protection Regulation, known as GDPR. Most agree the GDPR is a great step in the right direction for Europe. While many imagine the EU...

Continue Reading

The Data World Cup – Who will take it home?

The 2018 Fifa World Cup has kicked off in Russia, with the home team facing Saudi Arabia. Highly skilled players are coming to represent countries from around the globe, and every country has the chance to go home with the trophy. However, when it comes to the technology and data...

Continue Reading

Understanding the Big Data DevOps Shortage

Big data skills shortages continue to grab headlines, as they have for years. A look beneath those headlines reveals important context. Things have changed significantly in the age of the cloud. Commercial platforms like Cloudera and Hortonworks have evolved and there are a variety of -aaSes in the cloud: PaaS...

Continue Reading

4IR Report: Who’s Leading the Revolution?

Data is often left to the IT department to deal with. However, the insights made available by data analytics affect the entire organisation and therefore should be a boardroom issue. To see how IT can get itself into trouble, look no further than IT security. When there is a massive...

Continue Reading

Facebook’s telling off – who’s next for the naughty step?

With the help of a booster-seat, Facebook sat very much under the media spotlight in April, while the way it used customers’ personal data was scrutinised. The pressure is still very much on Facebook at the moment, although we can be sure it’s not the only technology giant that’s been...

Continue Reading

Data Lake Adoption by the Numbers

When data lakes first started springing up about eight years ago, there were more than a few ways to define them. It all depended on who you talked to. Water-related puns abounded, along with aquatically-themed warnings about swamps, sinkholes and puddles. Today, things are not that different. In fact, data...

Continue Reading

How big data helps companies become data-driven

A data-driven organization’s end goal should be to reach a stage where each decision requires data analysis and its use flows a firm’s processes naturally. Whether your employees are working on big data processes or different tasks, everyone in the organization should be capable of exploiting data independently. The idea...

Continue Reading

The role of the Chief Data Officer inside a company

Pete Williams, ex-Head of Enterprise Analytics at Marks and Spencer, now running his own outcome focused data consultancy, The Decision Playbook, shares with us in this interview his view around the transformational role of the CDO. His overall aim is to bring dynamic data to the heart of every business...

Continue Reading

The evolving role of the chief data officer

Team Keboola interviews Peter Jackson, CDO from Southern Water – Is the CDO figure a result of the digital transformation? – Why many businesses still don’t have a CDO? – Which are the consequences of not having a CDO? – How a data structure should look like in a business?...

Continue Reading

Five Must-Haves if You Want a Big Data PaaS

By Hannah Smalltree, Cazena If you’re considering a Platform as a Service for big data, analytics or data science – this is no holiday wishlist, these are requirements.   The platform-as-a-service (PaaS) market is growing quickly for big data and analytics, and for good reasons. The cloud PaaS model promises...

Continue Reading

7 Tableau tasks you can do

Post by Danish Wadhwa, While most people today are aware of Tableau, very few are aware of what this software does. Tableau’s potential is only limited by the imagination of the user; using it can help businesses in a massive way.   What is Tableau?   Tableau is a robust data...

Continue Reading

Yes you can be data-driven! A new approach to beat the fear factor

By Davy Nys, General Manager EMEA, ThoughtSpot Practically every company I talk to these days about big data has a vision to become “data-driven”. Despite this, there’s a wide gulf between vision and reality. Analyst firms report adoption rates for BI and analytics ranging from only 21 – 32 percent....

Continue Reading

What Will the Cities of the Future Look Like?

By the year 2050, it’s expected that two thirds of the population will be living in urban areas. This means city services will face a significantly higher demand. So, what will the urban landscape actually look like in three decades’ time? It’s possible technological advancements will completely reshape our infrastructure....

Continue Reading

Partner Event: InfiniteConf

Want to learn how to deliver actionable insights from big and fast data? How apps can more efficiently support decision making in a new era of smart cities design and planning cities? Eager to hear what’s new on Google’s Dataflow, or curious about using Python in the context of word...

Continue Reading

Which programming language should you learn?

Like any other career, choosing to enter the world of machine learning or data science requires a very particular set of skills. In the case of data science, knowing how to code in a particular language could open up the doors to many opportunities. However, many programmers working in the...

Continue Reading

Solving data integration challenges by using data warehouse automation

When it comes to data warehouses, the collected data can be stored in a number of different forms. In order to effectively analyse and use the data, data enterprises often need to integrate the information to make it compatible. This takes a lot of manual work, which, in turn, can...

Continue Reading

Machine Learning vs Deep Learning

Artificial intelligence has been a buzzword in the IT/Data industries for the last few years. Research and developments mean that it’s rapidly moving away from concept to reality. The fields of machine learning and deep learning are contributing significantly to making artificial intelligence a tool that can benefit businesses and...

Continue Reading

Why use clustering in data mining?

Data mining is one of many processes organisations can use to analyse their collected data. The process of data mining allows businesses to gather useful information. The data can be analysed from a number of different perspectives in order to give businesses valuable information that can boost revenue or cut...

Continue Reading

Artificial intelligence for data science

In the world of IT and computer science developments are speeding up rapidly. True artificial intelligence is the next step that those in the field are progressing towards and data science could both support the aim and benefit from the development. What’s data science? Data science is the processes and...

Continue Reading

How data wrangling solutions can improve data analytics

Data is fast becoming a valuable asset for businesses. With this insight, it is possible to identify trends, patterns and modes of behaviour that can be used to tailor a product or service to meet the needs of an audience exactly. However, in the age of the Internet of Things...

Continue Reading

Big Data: The 3 Vs explained

Big data can answer questions and open doors. But for those still stumped we’ve broken it down for you. There are three defining properties that can help break down the term. Dubbed the three Vs; volume, velocity, and variety, these are key to understanding how we can measure big data and just...

Continue Reading

CDO – Relating to the rest of the C suite

Authors: Caroline Carruthers, Chief Data Officer Network Rail, and Peter Jackson, Head of Data Southern Water There are more C suite roles than there used to be, the long established roles of Chief Executive and Chief Information Officer now have to compete for room at the table with roles like the...

Continue Reading

The value of transforming into a data-driven business

We live in an age of data, analytics and statistics – whether we like it or not. And in order to remain competitive, businesses need to grab hold of the data-driven opportunities on offer and incorporate analytics into their strategies. Companies that have not only embraced data, but utilised it...

Continue Reading

The Third Generation CDO

Authors: Caroline Carruthers, Chief Data Officer Network Rail, and Peter Jackson, Head of Data The Pensions Regulator. We’ve talked about the first and second generation CDO’s so what next? We have all heard that the CDO role is just a gimmick that companies are being sold, that won’t actually help them...

Continue Reading

The second generation CDO

Authors: Caroline Carruthers, Chief Data Officer Network Rail, and Peter Jackson, Head of Data The Pensions Regulator. A previous article proposed that a second generation CDO turns the ‘possible’ into an art form, ‘understanding the nuances of the family and making the house a home filled with wonder and intelligence’. The...

Continue Reading

Why is data visualisation important?

Data makes the business world go around. Informing decisions going forward, the ability to analyse and act on information collated by data is becoming increasingly important to businesses as they’re required to quickly react to changing demands. However, going one step further, data visualisation has become progressively important in the...

Continue Reading

First Generation v Second Generation CDO

Authors: Caroline Carruthers, Chief Data Officer Network Rail, and Peter Jackson, Head of Data The Pensions Regulator. Being a Chief Data Officer in the current climate is a rather interesting place to be, it can feel a little like dancing on quicksand while you have to learn to juggle wriggling snakes....

Continue Reading

Avoiding the Hype Cycle

Author: Caroline Carruthers, Chief Data Officer at Network Rail Being a Chief Data Officer in the current climate is a rather interesting place to be, it can feel a little like dancing on quicksand while you have to learn to juggle wriggling snakes. So in order to help people interested...

Continue Reading

Delivering a Data Strategy in the Cauldron of BAU

Authors: Caroline Carruthers, Chief Data Officer Network Rail, and Peter Jackson, Head of Data The Pensions Regulator. One of the most difficult tasks for the new CDO is developing a Data Strategy whilst the organisation continues to operate (and must continue to operate) using and abusing data, continuing with bad habits...

Continue Reading

Chief Data Officer – The first 100 days, part 2

Authors: Caroline Carruthers, Chief Data Officer Network Rail, and Peter Jackson, Head of Data The Pensions Regulator. So what are your ‘information basics’? From the last article we talked about the idea of getting your basics right but left you on a bit of a cliff hanger so thought we could revisit the...

Continue Reading

Chief Data Officer – The first 100 days, part 1

Authors: Caroline Carruthers, Chief Data Officer Network Rail, and Peter Jackson, Head of Data The Pensions Regulator. The first 100 days Part 1 Gartner predicted that by 2019, 90% of large organisations will have hired a CDO – but only 50% of these will be a success. Much of what determines...

Continue Reading

The Secret Ingredients of the successful Chief Data Officer

Authors: Caroline Carruthers, Chief Data Officer Network Rail, and Peter Jackson, Head of Data The Pensions Regulator. Compared to most of the C-Suite colleagues the CDO is faced with a set of unique problems. There are similarities, the CDO is a subject specialist, and in that respect is similar to the Chief Finance Officer, Chief Investment Officer or...

Continue Reading

So why does any organisation need a Chief Data Officer?

Authors: Caroline Carruthers, Chief Data Officer Network Rail, and Peter Jackson, Head of Data The Pensions Regulator So why does any organisation need a Chief Data Officer? If it’s at the right level it is a big investment and they aren’t going to just come on their own, a team of some...

Continue Reading

Hadoop and Spark – what are the differences?

Hadoop and Spark are the two main infrastructure framework available to store and process all of your big data. When Spark emerged in 2014, many predicted it would overtake Hadoop as the leading service, but the two both remain widely used. The biggest reason for this is the huge differences...

Continue Reading

Big Data vs Small Data

We have entered an age where data is becoming a highly valuable commodity. When managed effectively it can be used to provide intelligent consumer insight and predictive analysis to give a company a competitive edge, improving efficiency, safety and increasing profits on a huge scale. When it comes to forming...

Continue Reading

What is data wrangling?

Businesses of the modern age generate huge amounts of data every day and the data gathered continues to grow as more channels for accumulating information emerge. It is becoming increasingly important for businesses to organise and utilise the invaluable tool that is data and data wrangling can support this. In...

Continue Reading

Hiring a data scientist, what should you look for?

Data science is the process of extracting knowledge or insights from data. As businesses gather more data from various sources there is becoming a growing demand for data scientists to allow businesses to utilise the information they are gathering but finding the right one in a competitive industry can be...

Continue Reading

Analytics: Predictive, Descriptive & Prescriptive

Utilising big data can be a difficult process but with the right tools you can create powerful insights for your business. Capturing the information is just one of the challenges to businesses, they then need to interpret it but which analytical process offers the most advantages – descriptive, predictive or...

Continue Reading

Big Data – How do you keep it secure?

Big data is a helpful tool for businesses but it does present security risks that firms need to address in order to keep their information and insights secure. Extremely large data sets that have become known as big data are proving to be invaluable tools for businesses worldwide, for both...

Continue Reading

Big Data and the Blockchain

Big data and blockchain are two buzz words in business at the moment and both have the potential to change the way businesses operate. Together these two areas can help businesses become more secure and make operations more efficient. Blockchain is increasingly being used in different business sectors, with some...

Continue Reading

What is Analytics as a Service (AaaS)?

If you’re venturing into the world of big data, you may have heard the term Analytics as a Service. If you’re confused by what this actually means, our guide is here to help. The Basics At its most basic AaaS refers to the practise of using Web-based technologies to carry...

Continue Reading

Mistakes to Avoid When Using Big Data

Has your company recently decided to make the most of its big data? If so, here are some common mistakes to avoid. Don’t collect data indiscriminately At first, it may be tempting to jump right in and collect data on a whole host of topics without proper thought into how...

Continue Reading

Stopping big data becoming bad data

Big data can provide businesses with huge amounts of detailed insight, using information from a wide range of sources not only to solve existing pain points, but also to predict problems in the future and forecast previously unknown opportunities for growth. It comes as no surprise that data is becoming...

Continue Reading

How to manage IoT data?

The accelerated growth of the Internet of Things (IoT) is responsible for generating huge amounts of data, as many consumer, in-home and industrial devices are being embedded with software and sensors that gather virtual information, which is then transmitted to an internal hub via network connectivity. With such huge amounts...

Continue Reading

The Advantages of Moving Big Data to the Cloud

Over the last ten years, the storage and analysis of big data has taken place in huge data warehouses. Increasingly though, companies are moving their big data into the cloud, making the traditional warehouse method obsolete. Many believe making the move is a big undertaking, so what are the advantages...

Continue Reading

What’s next for big data in 2017?

Big data is a hugely valuable tool, helping businesses to improve productivity and performance – allowing them to expand and grow like never before. Big data is now big business around the globe –  but what innovations and changes can you expect to see in the coming year? Expansion It’s...

Continue Reading

Why Big Data is useful for every industry

Big Data allows businesses to gather and store large amounts of information for easy analysis. This can be useful for businesses in a myriad of industries, even ones you might not automatically think of. Big Data LDN is committed to helping business understand the benefits of big data, no matter...

Continue Reading

Predictive analytics vs Machine learning

Big data holds a lot of value that businesses can analyse and interpret to make cost savings, improve their business and drive operations forward. However, in order to access the wealth of information available the data needs to be processed in order to offer insights and different frameworks can have...

Continue Reading

How to transform data into useful management information

The saying ‘If you can’t measure it, you can’t manage it’ has long been linked to business and management. Big data now means that managers have access to a wealth of information that measures many different aspects of their business operations, customers and employees. While the information is now more...

Continue Reading

Why isn’t your business using NoSQL databases yet?

Businesses today are collecting huge amount of data every single day that can be used to benefit the business and its operations. The sheer volume of data that companies now deal with and store on a daily basis means that traditional frameworks are under pressure and in some cases are...

Continue Reading

Why businesses are using Big Data for competitive advantage

Data is now an important tool for businesses to utilise, whatever sector they operate in and whether they’re a global company or a small firm. Companies are increasingly using big data to gain a competitive advantage over business rivals but how does it benefit them? Analysing the datasets a business...

Continue Reading

Is Your Business Intelligent?

Asking whether your business is intelligent might seem like an unusual question but the response is becoming more important to companies that want to get ahead of rivals and maintain a competitive edge. Business intelligence is a set of techniques or tools used to acquire and transform raw data into...

Continue Reading

What is DataOps and Why Do We Need It?

As businesses churn out more and more data every day, the emergence of a new set of best practices has been helping to improve the coordination between the analysis of this data and the general operation of a business. These best practices are known as DataOps – and they’ve become...

Continue Reading

Improving Big Data Analytics with Machine Learning

The amount of data generated by businesses every single day is colossal – and it’s growing at an exponential rate. Many organisations are now reporting that they have a mass of unstructured data and no idea how to analyze it or use it in any way – from emails to...

Continue Reading

How To Become A Data-Driven Company

The value of big data can’t be overstated for businesses nowadays. The collection and analysis of data has allowed thousands of businesses to make decisions that are driven by that data, lending their decisions more weight and credibility – and even predicting the future with machine-learning. But how can you...

Continue Reading
CONTACT US