Blueprint Series: The Complete Guide to Observability

Easy-to-understand monoliths are giving way to distributed systems: microservices, serverless, meshes, and proxies in every possible combination. These systems offer developers the freedom to build new features and technology faster, as they are no longer beholden to the elaborate release processes associated with monolithic architecture. But, like all good things,...

Technology Modernisation Series: How to make use of Apache Flink

In this webinar, we will give an introduction into stateful stream processing with Apache Flink and show how it can enable you to build real-time, event driven applications. We will take you through the journey of enabling customer 360 / personalisation applications and building a dynamic fraud detection engine. We...

The Impacts of Big Data in Cloud, Hybrid and Multi-Cloud Environments

Technology Modernisation Series: NoSQL Database Management

In this webinar, part of our Technology Modernisation Series, we are looking at the business case for upgrading your RDBMS to a more current data architecture so as to meet the demands of modern applications. We’re delighted to be joined by Brian Mortimore, Principle Architect, Datastax. Talk 1; Migrating RDBMS...

Graph Data Science: What’s the big deal?

Graph data science lets you leverage the power of relationships — the connections between your data points —  to improve model prediction and answer previously intractable questions. Alicia Frame, Lead Product Manager for Data Science at Neo4j, will demonstrate the value of connected data for improving your data science and analytics applications....

Building an Agile & Iterative Data Strategy and Team

In this webinar we are joined by Jason Foster, CEO and Founder of Cynozure and Barry Green, CDO at Allianz where they will be discussing best practice on how to build an agile and iterative data strategy and team. During the joint presentation/discussion Jason and Barry will cover; -Why a...

Data Transformation Series: Scaling Energy Data in the Cloud

Episode 1: Energy Trading in the Cloud Over the coming months we will be running several webinars as part of a Data Transformation Series, where we will hear success stories from companies from a variety of sectors. In this, the first of this series, we’re pleased to welcome Swiss Utility...

Modern Data Architecture Series: Data Visualisation

With multiple analytical systems now being implemented in organisations, a major challenge is how to empower end users not only to leverage these systems and be able to connect to data within them, but also to enable them to invoke analytical assets they create such as machine learning models and...

Modern Data Architecture Series: Data Warehousing

Industry Analyst, Mike Ferguson examines the findings of November’s 4th Industrial Revolution Report to shed some light on the latest trends in data warehousing. With many respondents indicating that they would be moving their analytical workloads to the cloud, one such trend is the movement towards using a scalable, pay...

The Top 5 Use Cases Driving Graph Adoption

This Big Data LDN Digital webinar is centred on Graph Analytics and the ways that data teams from varied sectors are using Graph for business benefit. It will also feature a guest presentation from former Chief Analytics Officer of JustGiving, Mike Bugembe, author of Cracking the Data Code. Mike will...

Modern Data Architecture Series: Data Integration

Managed Data Integration – Best Practices for The Data-Driven Enterprise Independent Analyst, Mike Ferguson elaborates on how a managed data integration environment can be used to create an information supply chain and how this in turn can fuel collaborative component-based continuous development using a data integration fabric for enterprise DataOps....

Tips and Tricks for Data Teams During Lockdown

The recent spread of COVID-19 has meant that work, for the majority of data professionals around the world, has changed beyond all recognition. The Big Data LDN Digital: Lockdown Special, is an hour-long broadcast aiming to provide ideas and information for people who work in data in these unprecedented times....

BIG DATA LDN Refresh: Data, The Musical – with LW Theatres

Over the next few weeks Big Data LDN will be revisiting some of the highlights from our 2019 Conference in November as part of our Refresh series. More than 130 sessions at Big Data LDN 2019 were recorded split across 8 distinct content streams; DataOps, Data-Driven, Self-Service Analytics, Customer Experience,...

BIG DATA LDN Refresh: Zero Trust and Big Data

Over the next few weeks Big Data LDN will be revisiting some of the highlights from our 2019 Conference in November as part of our Refresh series. More than 130 sessions at Big Data LDN 2019 were recorded split across 8 distinct content streams; DataOps, Data-Driven, Self-Service Analytics, Customer Experience,...

BIG DATA LDN Refresh: Counting unique users in real time

Over the next few weeks Big Data LDN will be revisiting some of the highlights from our 2019 Conference in November as part of our Refresh series. More than 130 sessions at Big Data LDN 2019 were recorded split across 8 distinct content streams; DataOps, Data-Driven, Self-Service Analytics, Customer Experience,...

BIG DATA LDN Refresh: Unit Testing with Pytest

Over the next few weeks Big Data LDN will be revisiting some of the highlights from our 2019 Conference in November as part of our Refresh series. More than 130 sessions at Big Data LDN 2019 were recorded split across 8 distinct content streams; DataOps, Data-Driven, Self-Service Analytics, Customer Experience,...

BIG DATA LDN Refresh: How Sherlock solved Card Fraud

Over the next few weeks Big Data LDN will be revisiting some of the highlights from our 2019 Conference in November as part of our Refresh series. More than 130 sessions at Big Data LDN 2019 were recorded split across 8 distinct content streams; DataOps, Data-Driven, Self-Service Analytics, Customer Experience,...

Big Data LDN Refresh: AI Lab

Over the next few weeks Big Data LDN will be revisiting some of the highlights from our 2019 Conference in November as part of our Refresh series. More than 130 sessions at Big Data LDN 2019 were recorded split across 8 distinct content streams; DataOps, Data-Driven, Self-Service Analytics, Customer Experience,...

Big Data LDN Refresh: Data Management

Over the next few weeks Big Data LDN will be revisiting some of the highlights from our 2019 Conference in November as part of our Refresh series. More than 130 sessions at Big Data LDN 2019 were recorded split across 8 distinct content streams; DataOps, Data-Driven, Self-Service Analytics, Customer Experience,...

Big Data LDN 2019 nominated for 2 industry awards

3rd Street Group, the organisers of Big Data LDN, are delighted to announce that Big Data LDN 2019 has been nominated in two categories in the upcoming Exhibition News Awards. The event that took place on 13-14 November 2019 has been shortlisted in both the Best Marketing campaign for a...

Big Data LDN 2019: The Promise Of Data Mastering At Scale

Speaker: Michael Stonebraker Synopsis: Master data management (MDM) software turned 15 years old this year. Originally launched in 2004 by SAP, master data management systems aimed to help resolve the data unification problem by creating a central source of standardized references to customers, products, employees, suppliers, physical assets and other...

Big Data LDN 2019: Quick And Easy Access To Data Through A Logical Data Warehouse Environment

Speaker: Sylvain Dutilh Synopsis: Landsbankinn is the leading bank in Iceland because of its unified team, solid infrastructure, satisfied customers, and the benefits it provides to society and the Bank’s owners. In order to maintain and improve its position it needs fast access to unified data and to quickly deliver...

Big Data LDN 2019: Real-time Data Analytics At Scale Using Cloud Services

Speaker: Javier Ramirez, AWS Synopsis: Working with streaming data at scale is hard. Before you realize you can end up with a very sophisticated architecture with different moving parts you need to secure, monitor, and scale independently. In this session, you will learn how to work with real-time data, at...

Big Data LDN 2019: Harnessing The Power Of Data To Improve Public Health

Speaker: Peter Bradley, Public Health England Synopsis: Tech and data provide the health sector with innovative, more efficient and cost-effective ways to tackle some of the biggest health challenges our nation faces. This session looks at the role that data plays in a new way of intelligent public health where...

Big Data LDN 2019: Building A Modern Data Architecture For The Data Driven Enterprise

Speaker: Mike Ferguson, Intelligent Business Strategies Synopsis: Building A Modern Data Architecture For The Data Driven Enterprise

Big Data LDN 2019: What’s Your Origin Story? How AI Gives You Superpowers

Speaker, Rob Thomas, IBM Synopsis: AI has the potential to add $16 trillion to the global economy by 2030, but adoption has been slow. While we understand the power of AI, many of us aren’t sure how to fully unleash its potential. The reality is that AI isn’t magic. It’s...

Big Data LDN 2019: The Great Data Debate

Synopsis: In this year’s Great Data Debate keynote panel discussion at Big Data LDN, the focus is on Data and Analytics in the Cloud. Senior executives on some of the world’s major technology vendors will join Mike Ferguson, Conference Chairman of Big Data LDN to discuss issues such as: •...

Big Data LDN 2019: Data Skills: How Mondi Does Digital

Speaker: Jillian Augustine, Mondi Synopsis: Organisations are becoming more aware of the importance of data in their daily business. But hiring people with the right skills is only part of the process. Building a Digital Transformation team in a traditional, multinational industry comes with its own challenges. How do you...

Big Data LDN 2019: Data4Good

Speaker: Darren Crowder & Ritika Sehgal, TIBCO Synopsis: For many years, TIBCO has been integral to the success of multiple ‘Data4Good’ initiatives. Numerous charities and not-for-profit organisations have leveraged TIBCO technology to drive innovative projects that deliver results for the greater good of society, the environment, communities and ecosystems. You’ll...

Big Data LDN 2019: Achieving 100% Adoption Of Analytics In The Enterprise

Speaker: Rob Davis, MicroStrategy Synopsis: Traditionally most business intelligence software has been focused on the individual analyst. While the analyst is a key player obtaining insight for the organisation, a truly intelligent enterprise relies on ALL employees being able to leverage data and analytics in their day to day decisions....

Big Data LDN 2019: Multiparadigm Data Science: The Next Frontier In Decision Making

Speaker: Conrad Wolfram, Wolfram Research Synopsis: Has ‘Big Data’ led to better decisions at your organisation? If your answer isn’t an overwhelming ‘yes’, then come to Conrad Wolfram’s talk. From the core idea of symbolic computation to computable data, notebook interfaces, the latest in highly automated AI and computational knowledge,...

Big Data LDN 2019: Making Data Useful

Speaker: Cassie Kozyrkov, Google Abstract: Despite the rise of data engineering and data science functions in today’s corporations, leaders report difficulty in extracting value from data. Many organizations aren’t aware that they have a blindspot with respect to their lack of data effectiveness and hiring experts doesn’t seem to help....

Big Data LDN 2019: High Calibre Insights With Intelligent Analytics

Speaker: Sue Laine, ASG Technologies Synopsis: The challenge for all organisations is how to provide trusted insights across the distributed enterprise. Learn how the combination of a data Catalog, data lineage, data and metadata can deliver trusted datasets across many lines of business, whilst accommodating individual users needs for data,...

Big Data LDN 2019: Lessons learnt when architecting Data Lakes for real-time Analytics & AI

Speaker: Ted Orme, Attunity, A division of Qlik Synopsis: Modern analytics and AI initiatives require an adaptable data lake with a multistage architectural design to effectively ingest, stage, and provision specific datasets in real time. Ted Orme discusses his experience at Attunity, a division of Qlik – creating a real-time...

Big Data LDN 2019: Data Privacy Mythbusting

Speaker: Maurice Coyle, Truata Synopsis: Is customer trust dead? Trūata’s Chief Data Scientist, Dr. Maurice Coyle looks at this question and explores some of the myths around the use of personal data and consumer privacy. This session will debunk some of the most common data privacy myths as well as...

Big Data LDN 2019: Azure Data: Unmatched price-performance & limitless capabilities wherever your data lives

Speaker: Rohan Kumar Synopsis: Join Rohan Kumar, Corporate Vice President of Azure Data, to learn about the latest innovations on Microsoft’s data platform. Learn why Azure is the unmatched cloud in price-performance and how we are redefining cloud analytics with new and unrivaled capabilities. See our latest Kubernetes-based hybrid innovations...

Big Data LDN 2019: The database is only half done

Speaker: Ben Stopford, Confluent. Synopsis: Databases represent some of the most successful software that has ever been written and their importance over the last fifty years is hard to overemphasize. Over this time they have evolved to form a vast landscape of products that cater to different data types, volumes,...

Call for Papers – Big Data LDN 2020

Following our record breaking 2019 edition we are pleased to announce its call for papers is now open. We are returning to London Olympia for our 5th edition on 23rd-24th September 2020, this time in the largest hall (the Grand Hall). Due to the expansion Big Data LDN now boasts...

The Use of Big Data in Blockchain Technology

Blockchain technologies could be worth one-fifth of the big data market within the next two decades. So, how do the two go together? Blockchain investment is growing within governments, private businesses and banks. It is predicted that smart contracts could be worth around 10% of the world’s GDP within the...

Big future for big data at Big Data LDN

The record numbers of attendees (9150) crowding the walkways and free-to-attend theatres at Big Data LDN 2019 was proof positive London has a sparkling future as Europe’s capital of data regardless of how upcoming elections go. With a larger than ever crowd voting with its feet, to show up at...

Data projects delivered at cost deficit – how DataOps changes this

The industry talks a good game about value of data. But most organisations can only deliver use cases at a cost deficit.   The cost of acquiring, processing and storing the data is greater than the value to resell it or that it brings the organisation.  A recent large financial market...

Accelerating People Analytics

Journey of an HR function from raw data to predictive analytics within 8 months People analytics or analysis of employee data to solve business challenges is gaining momentum. The 2018 Deloitte Global Human Capital Trends report[1], based on a survey of 11,000 business leaders globally, revealed that 85 percent of...

Tackling the UK’s productivity puzzle: how AI can accelerate competitive advantage

It’s an unprecedented time for organisations across the UK. Amidst ongoing political and economic uncertainty, the need to boost productivity and remain competitive is more pressing than ever before. Yet, despite remaining top of C-Suite agendas, recent figures from the ONS reveal the UK is currently suffering the worst drop...

Democratising AI

As technology has evolved to become more accessible (as it always does!), the power of AI has grown such that it can now be utilised and applied by a range of consumers, students, scholars and professionals. At Wolfram, we are accelerating this democratisation of AI by automating challenging parts of...

The path to Data Intelligence and a data-enabled organisation

In today’s digital world, you would be hard-pressed to find a successful company that disagrees with the view that data is important It seems new articles pop up weekly claiming how data has become one of the most valued commodities in the world. It’s true: treated as a strategic asset,...

Government still distrusted on Big Data

Big Data LDN report shows new Government needs to make ‘giant leap’ to regain confidence of UK data leaders DOWNLOAD 4IR REPORT 2019 HERE Big Data LDN (London), today revealed findings from its UK Fourth Industrial Revolution 2019 Report. The independent research, commissioned by Big Data LDN and sponsored by...

REPORT DOWNLOAD: 4IR Report 2019

Independent research, commissioned by Big Data LDN and sponsored by Cloudera, surveyed 500 of the UK’s most influential data leaders as they struggle to juggle Brexit turmoil, increasing regulations and decipher the blurred lines of data ethics and data privacy. The UK’s impending divorce from the EU, paired with consistent...

Automated risk assessment tools are the future of data compliance

Privacy regulations such as GDPR, CCPA, and LGPD are requiring organizations to acquire consent in order to use their customers’ data for any purpose beyond the narrow one for which it was originally collected. Unless that data has been anonymized. How do organizations know if their data has been properly anonymized, and...

UK’s brightest data leaders gather at Big Data LDN 2019

Speakers include Google, Microsoft, Experian, Public Health England, Lloyds Bank, Cloudera and Cambridge Analytica whistleblower Chris Wylie. Big Data LDN (London), returns to Olympia London on November 13th and 14th for a fourth year. The event has surpassed all expectations since launching in 2016 with  130 exhibitors set to attend...

Speaker Spotlight: Paul Winsor

Big Data LDN catches up with Paul Winsor, General Manager, Retail at DataRobot Q – What does your day job entail? Retail has never been under more extreme pressure. This tension comes from the increased expectations of the empowered consumer and the need to have an accurate inventory to deliver...

Data as a Transactional Currency

As leaders across every industry sector seek to make better business decisions, there’s an ever louder cry of, “We need data!”. Yes, we all know the power of data, but harnessing its full potential relies on the ability of people and organisations to understand the true role and value of...

Big Data LDN Meetup: Implementing DataOps, notes from the front line

Speaker: Chris Conroy – Freelance Data Science Leader Implementing DataOps, notes from the front line Meetup filmed 17/10/2019

Big Data LDN Meetup: How AI can be used to enable assisted living for the ageing population

Voice assisted Living – We will discuss how the use of voice assistants such as google and Alexa can dramatically help dementia suffers with daily tasks as well as offering insights into the privacy, ethical and social responsibility concerns that must be considered. Speakers: Katie Gibbs – Head of AI,...

Big Data LDN Meetup: Why we defined a metalanguage for SQL

SQL adoption is growing quickly thanks to modern SQL warehouses and SQL technologies, enabling teams to do more and more with their data without having to write and maintain imperative code. Despite this, SQL still has many limitations which make it hard to adopt software engineering best practices such as...

Can you see the blind spots in your machine learning?

Looking back at the pace of innovation over the last 10 years it becomes increasingly difficult to imagine a world without artificial intelligence (AI). From product recommendation and self-driving cars to automatically understanding your receipts, AI – and specifically machine learning – has made huge strides into mainstream technology, and...

Big Data LDN highly commended at EN Indy Awards 2019

Big Data LDN  2018 was a finalist in Best Trade Show at Friday’s EN Indy awards and were delighted to be awarded the judges’ only Special Commendation in the category. Event Director, Bill Hammond, commented, “At this time of year, our attention is firmly set on making sure the 2019...

Machine learning – will your company be left behind?

Organisations currently using AI at scale are performing an average of 11.5% better than those who are not, according to Microsoft’s recent whitepaper Accelerating competitive advantage with AI. This is has increased from 5% just one year ago. The organisation’s research also found that in the UK alone there has...

The future calls for sustainable data

To mark the European Cyber Security Month, Statice is meeting industry leaders across Europe to discuss the latest trends in data privacy, as well as the greatest challenges corporations are facing in the provision of data-driven products and services to consumers. A universal recognition of the privacy of personal information...

Speaker Spotlight: Matt Pepper

In our third Speaker Spotlight for 2019, Big Data LDN catches up with Matt Pepper, Senior Sales Engineer at MicroStrategy.   Q – What does your day job entail? It varies from day to day, but mainly involves meeting customers and prospects to discuss their business problems and coming up...

Speaker Spotlight: Jonathan Westley

In our second Speaker Spotlight for 2019, Big Data LDN catches up with Jonathan Westley, Chief Data Officer at Experian.   Q – What does your day job entail? As organisations of all shapes and sizes increasingly find themselves in possession of more customer information than ever before, there also...

Meetup: The importance of Data Visualisation

Neil Richards, Data Visualisation Consultant/Evangelist from Groupon and General Director of the Data Visualization Society explains why you need better Data Visualization and more of it!! Meetup date: 19/09/19

Meetup: Machine Learning in action at Streetbees

Dr Sophia Goldberg, Machine Learning Researcher at rapidly growing London startup Streetbees talks about how they use AI to disrupt the market research industry. Meetup date: 19/09/19

Meetup: Revving up with Reinforcement Learning

In this talk you will hear about what reinforcement learning is and how we are using a small 1/18 scale car, the AWS Cloud and some good old fashion competition to generate interest in this field and help accelerate knowledge and learning. Speaker: Ricardo Sueiras, Technical Evangelist, AWS. Meetup date:...

Speaker Spotlight: Heather Gorr

In our first Speaker Spotlight for 2019, Big Data LDN catches up with Heather Gorr, Matlab Product Manager, Data Science at Mathworks.   Q – What does your day job entail?                          First, I open MATLAB and any other IDEs needed that day since my work life revolves around coding! I...

Big Data LDN Nominated for two Industry Awards

Big Data LDN has been nominated in the upcoming Exhibition News Indy Awards in the categories Best Marketing Campaign and Best Trade show. The awards are designed to recognise the achievements of independent event organisers and are taking place at The Honourable Artillery Company on the 11th October. Event Director...

Challenges of Big Data in Cybersecurity

With some of the biggest data breaches in history having taken place in 2019 alone, it’s clear that cyber-attacks aren’t going to disappear any time soon. From the Capital One banking data breach affecting over 100 million customers to the major breach of Flipboard potentially affecting over 1 billion users,...

Why is predictive analytics so important to businesses?

Failure to adapt to the future has scuppered many a business. Blackberry never saw the touchscreen coming, Blockbuster didn’t plan on streaming’s success and Myspace were more short-sighted than Facebook. Planning for the next corner is difficult in business but it’s not impossible. The data of today can reveal the...

Big Data LDN welcomes new faces to its Steering Group

Big Data LDN is pleased to welcome Johanna Hutchinson, CDO, The Pension’s Regulator, Tim Carmichael, CDO, Ensifera and Stefan Janusz, Policy Lead Government Office for Artificial Intelligence to its Steering Group committee. The Steering Group plays a vital role in shaping the content delivered at Big Data LDN ensuring it...

Is There an AI Talent Shortage?

While AI adoption is a hot topic in the business and tech sectors, most of the media — well-known publications included — aren’t well versed in its intricacies. Adding to this issue are the differing opinions between academics and other AI experts as to what constitutes AI. So, you’ll frequently...

AI Bias and Data Quality

Artificial intelligence is not immune to human bias. Regardless of where AI is headed in terms of self-propagating algorithms and fully automated decision-action processes, the initial AI architecture is human-generated.  For better or for worse, humans have both implicit and explicit biases. Our brains are processing multiple environmental inputs (i.e.,...

Cambridge Analytica whistleblower Chris Wylie to headline Big Data LDN 2019 keynote programme

We are delighted to announce Chris Wylie will headline the Big Data LDN 2019 keynote programme. The New Yorker calls him “a pink-haired, nose-ringed oracle sent from the future”. Best known for his role in setting up – and then taking down – the cyberwarfare firm Cambridge Analytica, Chris has...

Big Data LDN Meetup: A Look at the technology of LUNO and Adjust

A look at Customer Data Pipelines in action with leading Bitcoin Exchange Luno and mobile marketing experts Adjust. Speakers: Srinu Chowhan, Head of Growth at Luno & Richard Smith, Solutions Partner at Adjust Meetup at Skills Matter, filmed 18th July. Meetup sponsored by mParticle

Big Data LDN Meetup: Move Fast And Make Things

The rise of the platform economy and how the most successful brands are making things happen off the back of a solid customer data foundation. Coupled with the importance of data interoperability in an organisation’s ability to provide a seamless and modern Customer Experience. Speakers: Tim Norris, VP Sales EMEA,...

The ICO holds CEOs responsible, but the customer is the boss

Hefty fines mean data regulation and ethics, previously a specialist topic, is now being discussed at the highest level of organisations. Facebook, in particular, knows data protection authorities have claws, being fined $5bn last week by America’s Federal Trade Commission. Brought on by privacy violations linked to the Cambridge Analytica...

Can the CDO be a profit centre?

We’ve all heard the grand quotes “Data is the new oil” and “Data powers the new economy” amongst others. But the reality is often very far from these bold statements. When I speak to my peers — too often they seem to get bogged down in the day to day...

The Modern Data Stack Approach: ELT Over ETL

ETL data pipelines — designed to extract, transform and load data into a warehouse — were, in many ways, designed to protect the data warehouse. Minimizing the amount of data that could be loaded helped preserve expensive on-premise computation and storage. However, the cost of processing power and storage with...

Blueprint Series: Data Engineering in Badoo, handling 20 billion events per day

Every day Badoo family projects users generate billions of events. Making sense of all that data is no small feat. Find out about tools and approaches we use to deliver, store, process and explore data in a unified way across all of our projects and brands. Speaker: Vladimir Kazanov, Data...

Blueprint Series: Achieve 100% Analytics Adoption with a New Class of Enterprise Intelligence

Despite having access to a wealth of data, organisations still struggle to effectively deliver trusted insights to the entire workforce—preventing them from realizing the full value of their data investments. Overcoming this challenge takes pervasive adoption of trusted analytics. This talk will cover: • Empowering business users with self-service analytics...

What is AI?

Technically, this is a mighty big question, the answer to which will vary depending on who you talk to. Marketers, and their content writing and copywriting associates, tend to overuse the term AI when their clients are actually deploying unsupervised machine learning or deep learning algorithms. In terms of machine...

Blueprint Series: The Data Landscape at Monsoon/Accessorize

This talk will cover Monsoon’s recent project to replace their BI stack. It will detail what the tech stack looked like previously and the business requirements that the project needed to fulfil to deem it a success. Then Jon will cover the migration and the benefits achieved and then conclude...

Looking ahead to DataTalks

DataTalks, the leading conference for Chief Data Officers and Data Leaders, is returning to London on 26/27 June. Here is an exclusive sneak preview of what attendees can expect from the widely anticipated conference programme. A programme for Data Leaders, by Data Leaders DataTalks provides next generation data thought leadership...

Bridging The Gap For Women In Tech

Despite the efforts of some of the biggest global technology brands, there is still a huge disparity between the number of male and female workers. In the wider tech industry, just 17% of employees are women and, according to a recent study by Analytics Insight, only 30% of women are...

GDPR one year on – the EU’s leaving present to the UK

Since 25th May 2018, the General Data Protection Regulation (GDPR) has dictated how organisations must record, share and process their customers’ personal data. Initially seen primarily as the realm of marketers and CRM administrators, the topic now permeates almost every business, having entirely changed the status quo on data protection....

MEETUP 13th June: Blueprint Series, Intelligent Engineering – Making sense of BIG data

The Big Data LDN Meetup group is continuing the Blueprint Series of data architecture meetups. On Thursday 13th June from 6:30pm, Skills Matter hosts the Blueprint Series, Intelligent Engineering – Making sense of BIG data TALK 1: Data Engineering in Badoo: handling 20 billion events per day Synopsis: Every day...

Does it have to be called Data Governance?

This is a question that I get asked fairly regularly. After all it is not an exciting title and in no way conveys the benefits that an organisation can achieve by implementing Data Governance. Sadly however, there is no easy yes or no answer. There are a number of reasons...

Why bother with a data driven transformation?

Regular engagement with our fellow Chief Data Officers and Chief Information Officers (who are all awesome by the way!) shows that the drivers pushing or drawing organisations into data driven transformation tend to come from one or more of five origins. The first is competitive advantage. Many organisations understand that...

Blueprint Series: Speed Up Your Apache Cassandra Applications – A Practical Guide to Reactive Programming

Speaker: Cedrick Lunven, Developer Advocate, DataStax Speaker Bio: Cedrick is a Developer Advocate at DataStax where he finds opportunities to share his passions by speaking about developing distributed architectures and implementing reference applications for developers. In 2013, he created FF4j, an open source framework for Feature Toggle which he still...

Blueprint Series: Inextricably Linked – Reproducibility and Productivity in Machine Learning

Speaker: Mark Coleman, VP Marketing at dotscience and Marketing Chairperson for Cloud Native Computing Foundation. Talk Synopsis: Because it is more complex and has far more moving parts, machine learning is where Software Development was in 1999: people are emailing and Slacking notebooks to each other, due to a lack...

Blueprint Series: Banking in the Cloud – Ultra-High Reliability Architectures

Data architecture for a challenger bank. Speaker: Jason Maude, Head of Technology Advocacy, Starling Bank Speaker Bio: Jason Maude is a coder, coach, and public speaker. He has over a decade of experience working in the financial sector, primarily in creating and delivering software. He is passionate about explaining complex...

Blueprint Series: A Platform for Freedom & Governance in the Cloud

Any enterprise seeking to create value from data has two conflicting and divergent objectives. On the one hand, cohorts of users and developers need to access data from multiple sources, to create analytics, dashboards, reports and apps. On the other hand, a responsible enterprise must secure, govern and define data...

Blueprint Series: Achieving Governance, Agility & Reduced Time to Value In An Increasingly Complex Data Landscape

In most organisations, the demand to analyse data continues to grow exponentially. New data from many new data sources are now being captured and new types of data stores are being created on multiple clouds as well as on-premise data centres. The result is that the data landscape is becoming...

Blueprint Series: Expedia Partner Solutions, Data Platform

Join Anselmo for an engaging overview of the new end-to-end data architecture at Expedia Group, taking a journey through cloud and on-prem data lakes, real-time and batch processes and streamlined access for data producers and consumers. Find out how the new architecture unifies a complex mix of data sources and...

Blueprint Series: Architecture Patterns for Implementing Serverless Microservices & Stream Processing

Join Richard who will talk about how the data science team at JustGiving built KOALA, a fully serverless stack for real-time web analytics capture, stream processing, metrics API, and storage service, supporting live data at scale from over 26M users. He will discuss recent advances in serverless computing, and how...

Blueprint Series: Engaging the people-power that underpins your data architecture

‘The importance of the ‘why’ behind what you do’ – Engaging the people-power that underpins your data architecture. Speaker: James Adams, Practice Lead – Workforce planning, Eden Smith. Filmed at Skills Matter/Code Node London on 14th March 2019 as part of the Big Data LDN Meetup Blueprint Series. Meetup sponsored...

UK Businesses Bullish with Data Governance

In the world of data governance, the only certainty is uncertainty. Headline regulations such as GDPR have been keeping CEOs up at night since 25th May 2018. However, while all are bound by GDPR’s legislation – none are more scared of ICOs wielding their newfound power than biggest organisations. Arguably...

Big Data LDN 2019 Call for Papers Open

Big Data LDN, the UK’s largest and foremost Big Data and Analytics Event, is pleased to announce its call for papers is now open. Returning to London Olympia for its 4th edition on 13th-14th November 2019, Big Data LDN now boasts an exclusive Keynote Track as well as 4 technical...

Blueprint Series: Expedia Partner Solutions, Data Platform

Big Data LDN Meetup: The Blueprint Series – 14th March 2019 Join Anselmo for an engaging overview of the new end-to-end data architecture at Expedia Group, taking a journey through cloud and on-prem data lakes, real-time and batch processes and streamlined access for data producers and consumers. Find out how...

Blueprint Series: Architecture Patterns for Implementing Serverless Microservices & Stream Processing

Big Data LDN Meetup: The Blueprint Series – 14th March 2019 Richard Freeman talks about how the data science team at JustGiving built KOALA, a fully serverless stack for real-time web analytics capture, stream processing, metrics API, and storage service, supporting live data at scale from over 26M users. He...

REPORT DOWNLOAD: Public Sector Data Report 2019

Big Data LDN, the UK’s largest exhibition and conference for data leaders, today revealed findings from its Public Sector Data Report 2019.  The independent research, commissioned by Big Data LDN and sponsored by Qlik, surveyed 100 public sector employees to discover how they keep on top of security, budget cuts...

Announcing Big Data LDN Training

After listening to feedback from delegates Big Data LDN is now offering training courses hosted by hand-picked industry experts. The first new 2-day Big Data LDN Training seminar looks at the business case for Data Warehouse Modernisation and explains why you need to do this, the tools and techniques needed to capture...

What is DataOps and Why Do We Need It?

As businesses churn out more and more data every day, the emergence of a new set of best practices has been helping to improve the coordination between the analysis of this data and the general operation of a business. These best practices are known as DataOps – and they’ve become...

Improving Big Data Analytics with Machine Learning

The amount of data generated by businesses every single day is colossal – and it’s growing at an exponential rate. Many organisations are now reporting that they have a mass of unstructured data and no idea how to analyze it or use it in any way – from emails to...

Predictive analytics vs Machine learning

Big data holds a lot of value that businesses can analyse and interpret to make cost savings, improve their business and drive operations forward. However, in order to access the wealth of information available the data needs to be processed in order to offer insights and different frameworks can have...

Machine Learning In Warehouse Management: Are We At A Breaking Point?

Machine learning is definitely an important topic in the technology sector. There are plenty of industries who are trying to develop strategies around their growth plan on the matter, given the fact that there are proven results of how machine learning applied to productivity works. Let’s analyse some big examples...

How to manage IoT data?

The accelerated growth of the Internet of Things (IoT) is responsible for generating huge amounts of data, as many consumer, in-home and industrial devices are being embedded with software and sensors that gather virtual information, which is then transmitted to an internal hub via network connectivity. With such huge amounts...

Data Science Skills & Careers – Launch of the Nurture Programme

GDPR Panel Debate

Collaborative Data Governance GDPR is only the Beginning

The Importance of Women in Data and Technology

Data Governance Reimagined

How to Leverage the Cloud for Business Solutions

The Logical Data Warehouse – A Modern Analytical Architecture

Cox Automotive – Big Data Journey

Data Leaders Panel Debate

Data Driven Transformation – Responsible change for the public good

Disruption in Data

The Intelligent Edge: What Data-driven Means in the Age of IoT

The CDO’s Playbook

The Big Data Journey

4th Industrial Revolution Survey – Panel Debate

Reshaping Digital Business with Augmented Intelligence

Deep Learning Demystified

Full Stack Analytics on Amazon Web Services

Real World Impact of a Global Data Fabric

Pervasive Intelligence – The future of big data, machine learning & IoT

How to Meet the Needs of Your Data hungry Organisation / Data Culture

Migrating Machine Learning to Spark on the Cloud

Analytics at ING – the why, what, and how of building a data driven financial enterprise

Creating ROI from Big Data Investments – Monetising Your Data Asset

Preserving the key principles of academic research in a business context

Breaking the rules of nature – proactive, predictive analytics

Stream all the things!!

Data Driven Performance with Mercedes AMG Petronas Motorsport

What Does Eye tracking Teach us about Dashboard Design?

DATA DRIVEN PERFORMANCE

Mercedes-AMG Petronas Motorsport has drawn from a combination of cutting-edge technologies and innovation, high-performance management and elite teamwork to win four consecutive FIA Formula OneTM World Constructors’ and Drivers’ Championships. The team continues its relentless pursuit of performance, which demands the effective storage, analysis and leveraging of data to derive...

THE DATA JOURNEY

Digital Transformation takes each of us on a journey. Doug Cutting will relate his journey, from search technology to open-source enterprise software, as well as what he’s learned helping enterprises embark on theirs, from siloed RDBMS-based systems, to IoT, AI and the cloud.

BIG DATA, DISRUPTION AND THE 800 POUND GORILLA IN THE CORNER

This talk will focus on the current market for “Big Data” products, specifically those that deal with one or more of “the 3 V’s”. I will suggest that the volume problem for business intelligence applications is pretty well solved by the data warehouse vendors; however upcoming “data science” tasks are...

OVERCOME BY EVENTS – APACHE KAFKA AND EVENT-ORIENTED ARCHITECTURE

In this talk, Jay Kreps will explain why the Military term ‘Overcome by Events’ or OBE can now be applied to systems – as they are being overrun by events. Confluent’s CEO will also discuss Event Oriented Architecture and how is it affecting the systems we build and scalability of...

2018 EVENT HIGHLIGHTS

13 Critical Capabilities for the Intelligent Enterprise

The Intelligent Enterprise represents the ultimate data-driven organisation. It injects data at the heart of its business and inspires an information-first culture. It fuels every person, device, and application with on-the-fly insights, predictions, and recommendations for smarter everyday decisions. It celebrates data, understands its customers, and provides products and services...

DATA, WHAT PEOPLE THINK AND WHAT YOU CAN DO TO BUILD TRUST.

PERFORMING SPATIAL ANALYTICS AT COLLECT+

DATABASE FOR THE INSTANT EXPERIENCE

BIG DATA TOO SLOW? SPRINKLE IN SOME NOSQL

DATA LITERACY: DATA IS THE NEW LANGUAGE OF BUSINESS. CAN YOUR ORGANISATION SPEAK IT?

BUILDING AN AIR QUALITY ROUTE APP FOR CITIZENS

‘NEW NUDGES’ – THE NEXT EVOLUTION IN CUSTOMER INFLUENCE

ENABLING DATA-DRIVEN DECISIONS WITH AUTOMATED INSIGHTS

FORBIDDEN PLANET – JEDI POWERS VERSUS QLIK

ENDING THE WAR FOR TALENT

HAVE YOU EVER WONDERED WHERE MASTER DATA MANAGEMENT FITS INTO YOUR DATA MANAGEMENT AGENDA?

WHY A DATA SERVICES MARKETPLACE IS CRITICAL FOR A SUCCESSFUL DATA-DRIVEN ENTERPRISE

DATA MANAGEMENT AUTOMATION AND THE INFORMATION SUPPLY CHAIN – FROM DATA LAKE TO DATA MARKETPLACE

ARE YOU READY FOR AI?

MACHINE LEARNING DATA CATALOGUES FOR AMBIENT GOVERNANCE

THE CHANGING FACE OF DATA GOVERNANCE

AI VS. GDPR

REALISING THE PROMISE OF SELF-SERVICE ANALYTICS WITH DATA VIRTUALISATION

TURNING MULTIPLE DATA LAKES INTO A UNIFIED ANALYTIC DATA LAYER

HOW TO BE A BETTER TECHNOLOGY BUYER

James Lupton and Jason Foster from Cynozure share their insights. Learn how to get the most from your technology partners by carefully selecting and managing the right suppliers at each stage of the data life-cycle.

MICROSOFT AZURE AND CLOUDERA – FLEXIBLE CLOUD, WHATEVER THE WORKLOAD

CONSISTENT SECURITY, GOVERNANCE AND FLEXIBILITY FOR ALL WORKLOADS – ON-PREMISES OR IN THE CLOUD

The growth of public cloud is reinforcing the need to think more carefully about taking a consistent approach to data governance as technology teams build out a flexible and agile infrastructure to meet the demands of the business. Join this session to learn more about Cloudera’s recommended approach for enterprise-grade...

THE FUTURE OF ENTERPRISE DATA – VOLUME 2

MICROLISE: USING BIG DATA AND AI IN TRANSPORT AND LOGISTICS

Microlise are a leading provider of technology solutions to the transport and logistics industry worldwide. Discover how, with over 400,000 connected assets generating billions of messages a day, Microlise is evolving its platform to bring real-time analytics to its customers to improve safety, security and efficiency outcomes.

EXPERIAN: MAXIMISE EVERY OPPORTUNITY IN THE BIG DATA UNIVERSE

DATA FOR THE 99%: UNLOCKING DATA CURIOSITY ACROSS YOUR ORGANISATION

Speaker: Ben Schein Organisation: DOMO There is a core BI dilemma that you will find at almost any organization. That dilemma simply put is: “Why does it always seem so hard to get the data and insight you need to solve a business problem?”. Strip away all the corporate politics...

A LOOK INSIDE APPLIED MACHINE LEARNING

Speaker: Brian Goral The field of machine learning (ML) ranges from the very practical and pragmatic to the highly theoretical and abstract. This talk describes several of the challenges facing organisations that want to leverage more of their data through ML, including some examples of the applied algorithms that are...

DEUTSCHE BANK: THE PATH TO AUTOMATION IN A HIGHLY REGULATED SPACE

MICROSOFT TECHNOLOGY UPDATE – LEVERAGING POWER BI IN THE BIG DATA ENTERPRISE

HOW TO TURN FRONT-LINE EMPLOYEES INTO DATA ANALYSTS WITH SEARCH DRIVEN ANALYTICS

FROM PROLIFERATION TO PRODUCTIVITY: MACHINE LEARNING DATA CATALOGUES

REACH FOR THE CLOUDS – ENABLE THE BUSINESS WITH THE POWER OF DATA

A PASSAGE TO AUTOMATED RETAIL REPORTING AT NOW TV

THE POWER OF AUTOMATION: HOW TO REDUCE 24 HOURS OF WORK TO 30 SECONDS

DATA APIS DON’T DISCRIMINATE

BRINGING BIG DATA UP TO EYE LEVEL

A TALE OF TWO BI STANDARDS: DATA WAREHOUSES AND DATA LAKES

FIGHTING DATA CHAOS: CONNECTING USERS TO DATA AT SCALE

INTELLIGENCE EVERYWHERE – POWER TO THE PEOPLE

NAVIGATING COMPLEX DATA MODELS WITH RELATIONAL SEARCH

2018 DATA TRENDS: RESULTS FROM FIFTH ANNUAL DATA AND ANALYTICS SURVEY

AGILE DATA MASTERING: THE RIGHT APPROACH FOR DATAOPS

IMPROVING FLOW-OF-GOODS THROUGH CLOUD-SCALE ANALYTICS

TIPS AND TRICKS TO WRANGLE BIG, DIRTY DATA

DELIVERING ON THE OPERATIONAL DATA WAREHOUSE PROMISE

MULTI-CLOUD MEGATRENDS FOR DATAOPS

THE HOLY GRAIL OF ANALYTICS. OUR EPIC FAIL… AND OUR REVOLUTIONARY POTENTIAL

BLISSFUL BI WITH BRANDWATCH

HOW RANK GAMING PRODUCTIONISED & AUTOMATED THE MANAGEMENT OF MACHINE LEARNING MODELS IN AZURE

HOW WE ENABLED DATAOPS AT SOUTHERN WATER

DATAOPS: BRINGING DEVOPS TO DATA INTEGRATION

USE MACHINE LEARNING TO GET THE MOST OUT OF YOUR BIG DATA CLUSTERS

PROJECT HYDROGEN: UNIFYING AI WITH APACHE SPARK

PUTTING TIME SERIES TO WORK!

USING FAST-DATA TO MAKE SEMICONDUCTORS

USING FAST DATA AND STREAM PROCESSING TO OPERATIONALISE MACHINE LEARNING

STREAM PROCESSING TAKES ON EVERYTHING

BUILDING ‘EBAY’ WITH SERVERLESS AND STREAM PROCESSING

HOW TO BECOME A BIG DATA ROCKSTAR IN 30 MINUTES!

STREAMING DATA MICROSERVICES WITH AKKA STREAMS, KAFKA STREAMS, AND KAFKA

STREAMING INTEGRATION: POWERING HYBRID CLOUD, MACHINE LEARNING AND FAST ANALYTICS

SCALING A PLATFORM FOR REAL-TIME FRAUD DETECTION WITHOUT BREAKING THE BANK

THE FUTURE OF STREAMING: GLOBAL APPS, EVENT STORES AND SERVERLESS

HOW TO MOVE HADOOP DATA TO THE CLOUD EFFECTIVELY, EFFICIENTLY WITH NO RISK

FORTUNE 100 LESSONS ON ARCHITECTING DATA LAKES FOR REAL-TIME ANALYTICS

CHARTING ZERO LATENCY FUTURE WITH REDIS

SHAPING AN AI-DRIVEN FUTURE WITH AUGMENTED INTELLIGENCE FOR ENTERPRISES

ASSEMBLING A TEACHER BOT WITH MACHINE LEARNING, NLP, ACTIVE LEARNING AND MICROSERVICES

HOW AUTOMATION CAN ACCELERATE THE DELIVERY OF MACHINE LEARNING

LESSONS LEARNED FROM DEPLOYING REAL-WORLD AI SYSTEMS

DEEP LEARNING AND THE CHALLENGE OF SCALE

THE PATH TO ENTERPRISE AI: TALES FROM THE FIELD

DATA OPERATIONS PROBLEMS CREATED BY DEEP LEARNING, AND HOW TO FIX THEM!

LETS BUILD A ROBOT

AUTOMATED MACHINE LEARNING

PROMISE AND PITFALLS OF TEXT ANALYTICS

AI MEETS MAIL PROCESSING

AI LIKE AN EXPERT

CONNECTING SILOS IN REAL-TIME WITH DATA VIRTUALIZATION

Speaker: Becky Smith Organisation: Denodo How many users inside and outside of your organization access your organization’s data? Dozens? Hundreds is probably more like it, each with their own structure and content requirements as well as different access rights. As a result, many organizations have witnessed the formation of “data...

THE NEXT WAVE: DATA, AI AND ANALYTICS IN 2019 AND BEYOND

Speaker: Matt Aslett Organisation: 451 Research As 2018 draws to a close, Matt Aslett, Research VP, 451 Research looks ahead to 2019 and the key trends the research company’s Data, AI and Analytics team is anticipating for the year ahead, including the continued rise of DataOps; the increased importance of...

7 SUCCESSFUL HABITS FOR DATA-INTENSIVE APPLICATIONS IN PRODUCTION

Speaker: Ellen Friedman Organisation: MapR We’ve seen that over 90% of our customers have large scale projects successfully in production. What are they doing right? And how can you adapt their effective habits to your own business? Value comes from big data when you have successful production deployments of data-intensive...

DATA SCIENCE AT ING

Speaker: Bas Geerdink, IT Manager, Fast Data Analytics, ING Bank

BIG DATA IS MODERN DATA

Speaker: Eliot Horowitz Organisation: MongoDB The bigness of data is but one of the challenges facing modern enterprise data engineers. Of course we have to store it all, but a warehouse isn’t acceptable any more — developers have to be able to use it naturally, and it needs to be...

BIG DATA, DISRUPTION AND THE 800 POUND GORILLA IN THE CORNER

This talk will focus on the current market for “Big Data” products, specifically those that deal with one or more of “the 3 V’s”. I will suggest that the volume problem for business intelligence applications is pretty well solved by the data warehouse vendors; however upcoming “data science” tasks are...

PROGRESS FOR BIG DATA IN KUBERNETES

Ted Dunning, MapR Kubernetes is trending and for good reason. Containers and effective orchestration and management of them like Kubernetes provides can make it much easier to manage the wild proliferation of systems and services that we are seeing in on premises data centers and in the cloud. Kubernetes has...

ACCELERATING YOUR ANALYTICS JOURNEY WITH REAL-TIME AI

AI is right here, right now—and changing our lives. The ever-present need for business optimization, combined with a long history of applied statistics, explosive growth in available data and recent advances in cloud computing, has created a perfect storm of innovation. This presentation shows real-time AI in action, including real-world...

THE THIRD REVOLUTION IN ANALYTICS

DATA DRIVEN PERFORMANCE

Mercedes-AMG Petronas Motorsport has drawn from a combination of cutting-edge technologies and innovation, high-performance management and elite teamwork to win four consecutive FIA Formula OneTM World Constructors’ and Drivers’ Championships. The team continues its relentless pursuit of performance, which demands the effective storage, analysis and leveraging of data to derive...

THE DATA JOURNEY

Digital Transformation takes each of us on a journey. Doug Cutting will relate his journey, from search technology to open-source enterprise software, as well as what he’s learned helping enterprises embark on theirs, from siloed RDBMS-based systems, to IoT, AI and the cloud.

OVERCOME BY EVENTS: APACHE KAFKA AND EVENT-ORIENTED ARCHITECTURE

In this talk, Jay Kreps will explain why the Military term ‘Overcome by Events’ or OBE can now be applied to systems – as they are being overrun by events. Confluent’s CEO will also discuss Event Oriented Architecture and how is it affecting the systems we build and scalability of...

Five stars: the ingredients for a digital revolution

Slow and steady doesn’t always win – sometimes revolutionary thinking is needed for a dramatic upheaval. We are experiencing huge changes in the digital world, both in industry-wide technology “uprisings” such as artificial intelligence and edge computing, and from innumerable internal digital transformation projects where the revolutionary spark is catching...

Work needed to maintain London’s reign as Europe’s data capital

In the wake of data scandals, UK CEOs take greater ownership of data and leaders look to the UK Government to regulate tech giants LONDON, UK – 13 November 2018 – Big Data London (BDL), the UK’s largest exhibition and conference for data leaders, today revealed findings from its UK...

The Legacy of Technology

Information Technology (IT) has evolved over the last three decades from a few punch cards, to a few computers, and now to entire networks of computers. But how has this rapid expansion of technology affected business over the years? For one thing: there are now hundreds, if not thousands, of...

Women in Big Data Breakfast at Big Data LDN

Don’t miss the Women in Big Data Breakfast at Big Data LDN on 13th November Register here! What will be taking place? An introduction to the Women in Big Data Program, sharing ideas on how to address the diversity gap in Big Data (including ML, AI, etc..)  Hear the accomplishments...

ERP data access: 5 top tips

One of the most-read blogs on the ZAP website is a piece I wrote earlier this year with advice for successful ERP data access. This will undoubtedly be a hot topic at Big Data LDN but, with so much great information coming out of the event, I’ll cut to the...

Where to start your data-driven journey

Looking for value in all the right places. At a recent visit to a local bookstore, I noticed something I hadn’t spotted before: there were far more books on self-help than there were on the subject of business improvement. At home, I did a quick search on Amazon.com: more than...

How being data driven gets you to pole position

At TIBCO we know that harnessing data during digital transformation is at the core of adapting, evolving and winning. Data is an insight as relevant for motorsport teams competing in Formula One™, as it is for those decision-makers in charge of businesses. Data is the rich and invaluable fuel that...

Four Steps to Achieving Data Utopia

In the run-up to Big Data LDN 2018 I got to thinking about this year’s theme “From the Fourth Industrial Revolution to data utopia”. Most large enterprises I’ve been working with this year are transforming digitally, striving to reach that utopia. In reaching that destination, I believe nothing is more...

Data industry comes of age as business leaders invited to ready themselves for the big data revolution at BIG DATA LDN

Knowledge is power – and business leaders looking for ways to get ahead of the competition and excel in a data-driven world will find world-class know-how, insight and instruction in abundance at Big Data LDN, the largest data and analytics conference and exhibition in the UK next week. Entirely free...

Hybrid Optimal Processing Environment – HOPE for us all?

In a world seemingly threatened by AI and RPA (not to mention acronyms in general..), it is reassuring to step back and look at the reality. Whilst many mundane tasks can be automated using so-called ‘bots’, the requirement for human intervention still exists and should not be underestimated. At the...

Extracting Value from Insights in “The Last Mile”

Recently, I read the McKinsey article “Breaking away: The secrets to scaling analytics.” The article discussed their findings on the importance of analytics to a company’s success. Unsurprisingly, they found that the most successful companies spend more money and effort on analytics, specifically embedded analytics. Two thirds of what they...

Is Your Storage Ready for 44 Zettabytes of Big Data?

Alex McMullan, CTO, International, Pure Storage. By 2020, every human will generate 1.7MB of data per second. In addition, big data will soon surpass the 44 zettabyte mark. This is staggering when you consider that only 0.5% of data is actually analysed and used. Yet every organization, from automotive to finance...

What is Robotic Process Automation?

Margaret’s father suffered a massive stroke on the Christmas Eve and had to undergo an Angioplasty. She had to withdraw money for the surgery but was unable to recollect the card pin. A decade ago, one has to be vigilant about the bank working hours, wait for days, and follow...

AI in Digitization

Global economy is transforming into a digital economy. What started out as an idea with potential, has now turned out to be a powerful force that has disrupted all industries across the globe. Today, more companies are using and becoming familiar with the implementation of Artificial Intelligence in their digital...

Partner Event – DataTalks: The Conference for Data Leaders by Data Leaders

On the 8th and 9th November 2018 together with Carruthers & Jackson and Eden Smith, Big Data LDN producers 3rd Street Group LTD will be hosting data leaders at the Andaz hotel. Join Us There will be practical workshops as well as the opportunity to learn from thought leaders about the...

The Advantages of Moving Big Data to the Cloud

Over the last ten years, the storage and analysis of big data has taken place in huge data warehouses. Increasingly though, companies are moving their big data into the cloud, making the traditional warehouse method obsolete. Many believe making the move is a big undertaking, so what are the advantages...

Big data’s impact on virtual reality businesses

Virtual reality is a technology with boundless opportunities. These can be seen when it is paired with other tech to create new opportunities. When paired with gaming for example, VR has enabled the user to enter the virtual world of the game, such as in online casinos where the user...

Matei Zaharia joins keynote lineup

Big Data LDN is pleased to announce another global data expert confirmed to speak in the Big Data LDN keynote theatre. Matei Zaharia started the original Apache Spark computing engine and helped to develop other widely used open source software including Apache Mesos, Alluxio and job schedulers for Apache Hadoop....

Big Data: The 3 Vs explained

Big data can answer questions and open doors. But for those still stumped we’ve broken it down for you. There are three defining properties that can help break down the term. Dubbed the three Vs; volume, velocity, and variety, these are key to understanding how we can measure big data and just...

Data Independence Day – Make data great again

The fourth of July saw millions of Americans celebrating independence. Independence from the laws and regulations of Europe, the most recent being the EU General Data Protection Regulation, known as GDPR. Most agree the GDPR is a great step in the right direction for Europe. While many imagine the EU...

The Data World Cup – Who will take it home?

The 2018 Fifa World Cup has kicked off in Russia, with the home team facing Saudi Arabia. Highly skilled players are coming to represent countries from around the globe, and every country has the chance to go home with the trophy. However, when it comes to the technology and data...

Hadoop and Spark – what are the differences?

Hadoop and Spark are the two main infrastructure framework available to store and process all of your big data. When Spark emerged in 2014, many predicted it would overtake Hadoop as the leading service, but the two both remain widely used. The biggest reason for this is the huge differences...

Further Speakers Confirmed for 2018 Event

Big Data LDN is pleased to reveal  three new speakers confirmed to present at Big Data LDN in November 2018: Eliot Horowitz – CTO & Co-Founder at MongoDB Eliot Horowitz is the CTO and Co-Founder of MongoDB. He wrote the core code base for MongoDB starting in 2007, and subsequently built the engineering...

Understanding the Big Data DevOps Shortage

Big data skills shortages continue to grab headlines, as they have for years. A look beneath those headlines reveals important context. Things have changed significantly in the age of the cloud. Commercial platforms like Cloudera and Hortonworks have evolved and there are a variety of -aaSes in the cloud: PaaS...

REPORT DOWNLOAD: 4IR Report 2018

Data is often left to the IT department to deal with. However, the insights made available by data analytics affect the entire organisation and therefore should be a boardroom issue. To see how IT can get itself into trouble, look no further than IT security. When there is a massive...

Facebook’s telling off – who’s next for the naughty step?

With the help of a booster-seat, Facebook sat very much under the media spotlight in April, while the way it used customers’ personal data was scrutinised. The pressure is still very much on Facebook at the moment, although we can be sure it’s not the only technology giant that’s been...

Data Lake Adoption by the Numbers

When data lakes first started springing up about eight years ago, there were more than a few ways to define them. It all depended on who you talked to. Water-related puns abounded, along with aquatically-themed warnings about swamps, sinkholes and puddles. Today, things are not that different. In fact, data...

Why use clustering in data mining?

Data mining is one of many processes organisations can use to analyse their collected data. The process of data mining allows businesses to gather useful information. The data can be analysed from a number of different perspectives in order to give businesses valuable information that can boost revenue or cut...

Big Data LDN – 2018 Theatres Announced

8 Content Tracks, with 3 NEW Theatres for 2018! Big Data LDN is pleased to announce the 8 content theatres that will host cutting-edge presentations, real-world use-cases and inspiring demos from 130+ speakers at Big Data LDN 2018 on 13-14 November. Learn from global data experts in the Keynote Theatre, Fast...

Deep Learning demystified

The last five years has seen an unprecedented progress in Artificial Intelligence research. Neural Networks, which were perceived as a failed experiment of Machine Learning research, not only are successfully solving a wide range of everyday problems but in many cases significantly exceed human performance. Adam Grzywaczewski, Deep Learning Solution Architect...

Breaking the rules of nature – proactive, predictive analytics

Predictive analytics helps companies gain advantage. By drawing insight from the widest range of data sources, companies can build an accurate visualisation of the future and model their process to match. By helping them expect the unexpected, predictive analytics facilitates better planning, happier customers and healthier profits. However, sometimes you...

Creating ROI From Big Data Investments – Monetising Your Data Asset

Companies are investing untold amounts of money and time into their data ecosystems all in an attempt to benefit from greater insights and an ability to take smarter and faster action across their business. Most recently, innovative companies have invested further into new Big Data solutions designed to get them...

Machine Learning: What works and what they don’t tell you

Machine learning can extract real business value in an amazing range of situations. To make machine learning actually work, however, you need practical knowledge that can be hard to come by except through the school of hard knocks. Ted Dunning has been there and shortcuts this for you by presenting...

Analytics: Predictive, Descriptive & Prescriptive

Utilising big data can be a difficult process but with the right tools you can create powerful insights for your business. Capturing the information is just one of the challenges to businesses, they then need to interpret it but which analytical process offers the most advantages – descriptive, predictive or...

2018 Opening Keynotes Confirmed!

Big Data LDN are pleased to announce that Jay Kreps and Miachel Stonebraker will be delivering the two opening keynotes at Big Data LDN 2018. Jay Kreps, opens the event on day 1, Tuesday 13th November. The Ex-Lead Architect for Data Infrastructure at LinkedIn, Co-creator of Apache Kafka and Co-founder...

Customer Experience/Insight Meetup (easyJet & MRM Meteorite)

Join the Big Data LDN team at the second Data-Driven LDN Meetup, taking place at 6:30pm on 28th March at Skills Matter/Code Node London. Hear experts from easyJet and MRM Meteorite discuss how Big Data powers customer engagement and improves experience and interactions with brands, and what that means to us,...

How big data helps companies become data-driven

A data-driven organization’s end goal should be to reach a stage where each decision requires data analysis and its use flows a firm’s processes naturally. Whether your employees are working on big data processes or different tasks, everyone in the organization should be capable of exploiting data independently. The idea...

The role of the Chief Data Officer inside a company

Pete Williams, ex-Head of Enterprise Analytics at Marks and Spencer, now running his own outcome focused data consultancy, The Decision Playbook, shares with us in this interview his view around the transformational role of the CDO. His overall aim is to bring dynamic data to the heart of every business...

The evolving role of the chief data officer

Team Keboola interviews Peter Jackson, CDO from Southern Water – Is the CDO figure a result of the digital transformation? – Why many businesses still don’t have a CDO? – Which are the consequences of not having a CDO? – How a data structure should look like in a business?...

Five Must-Haves if You Want a Big Data PaaS

By Hannah Smalltree, Cazena If you’re considering a Platform as a Service for big data, analytics or data science – this is no holiday wishlist, these are requirements.   The platform-as-a-service (PaaS) market is growing quickly for big data and analytics, and for good reasons. The cloud PaaS model promises...

7 Tableau tasks you can do

Post by Danish Wadhwa, While most people today are aware of Tableau, very few are aware of what this software does. Tableau’s potential is only limited by the imagination of the user; using it can help businesses in a massive way.   What is Tableau?   Tableau is a robust data...

Yes you can be data-driven! A new approach to beat the fear factor

By Davy Nys, General Manager EMEA, ThoughtSpot Practically every company I talk to these days about big data has a vision to become “data-driven”. Despite this, there’s a wide gulf between vision and reality. Analyst firms report adoption rates for BI and analytics ranging from only 21 – 32 percent....

REPORT DOWNLOAD: 4IR Report 2017

Introducing Data-Driven LDN, a brand new conference theatre at Big Data LDN, focused on how to build a successful enterprise-wide data culture. This track shows how to align business objectives with data strategy, highlighting issues around data ownership, GDPR, culture, skills, regulation, governance and strategic technology architecture. Data-Driven LDN examines...

Big Data LDN 2017 returns to drive the UK’s data agenda

The free to attend event is back after its record-breaking opening year with data leaders from Uber, Microsoft and ING   Big Data LDN, the only delegate-led Big Data event in the UK, returns to Olympia London on November 15th and 16th after a phenomenal inaugural year in 2016. The...

Big Data and the Blockchain

Big data and blockchain are two buzz words in business at the moment and both have the potential to change the way businesses operate. Together these two areas can help businesses become more secure and make operations more efficient. Blockchain is increasingly being used in different business sectors, with some...

Leading Chief Technology Officers to open Keynote Programme

Big Data LDN are delighted to announce that Amr Awadallah, Chief Technology Officer and co-founder at Cloudera will open day 2 of Big Data LDN, delivering a keynote on machine learning, AI & the future of big data analytics. Amr joins previously confirmed Neha Narkhede, Chief Technology Officer and co-founder at...

What Will the Cities of the Future Look Like?

By the year 2050, it’s expected that two thirds of the population will be living in urban areas. This means city services will face a significantly higher demand. So, what will the urban landscape actually look like in three decades’ time? It’s possible technological advancements will completely reshape our infrastructure....

Confluent CTO Keynote

Big Data LDN can confirm that Apache Kafka Co-creator and current Confluent Co-founder & CTO Neha Narkhede will deliver the opening keynote on day 1, 15th November 2017. Keynote: The Rise of the Streaming Platform Neha will discuss how to build operable large scale data systems in the Big Data LDN Keynote Theatre Neha Narkhede is...

Which programming language should you learn?

Like any other career, choosing to enter the world of machine learning or data science requires a very particular set of skills. In the case of data science, knowing how to code in a particular language could open up the doors to many opportunities. However, many programmers working in the...

Solving data integration challenges by using data warehouse automation

When it comes to data warehouses, the collected data can be stored in a number of different forms. In order to effectively analyse and use the data, data enterprises often need to integrate the information to make it compatible. This takes a lot of manual work, which, in turn, can...

2017 Theatres Announced

Big Data LDN 2017 will host leading, global data and analytics experts, speaking in 4 theatres, with content to arm you with the tools to deliver the most effective data-driven strategy for your business. Fast Data Theatre With the arrival of modern streaming platforms, businesses are rethinking data with real-time processing at...

Machine Learning vs Deep Learning

Artificial intelligence has been a buzzword in the IT/Data industries for the last few years. Research and developments mean that it’s rapidly moving away from concept to reality. The fields of machine learning and deep learning are contributing significantly to making artificial intelligence a tool that can benefit businesses and...

Artificial intelligence for data science

In the world of IT and computer science developments are speeding up rapidly. True artificial intelligence is the next step that those in the field are progressing towards and data science could both support the aim and benefit from the development. What’s data science? Data science is the processes and...

How data wrangling solutions can improve data analytics

Data is fast becoming a valuable asset for businesses. With this insight, it is possible to identify trends, patterns and modes of behaviour that can be used to tailor a product or service to meet the needs of an audience exactly. However, in the age of the Internet of Things...

CDO – Relating to the rest of the C suite

Authors: Caroline Carruthers, Chief Data Officer Network Rail, and Peter Jackson, Head of Data Southern Water There are more C suite roles than there used to be, the long established roles of Chief Executive and Chief Information Officer now have to compete for room at the table with roles like the...

The value of transforming into a data-driven business

We live in an age of data, analytics and statistics – whether we like it or not. And in order to remain competitive, businesses need to grab hold of the data-driven opportunities on offer and incorporate analytics into their strategies. Companies that have not only embraced data, but utilised it...

The Third Generation CDO

Authors: Caroline Carruthers, Chief Data Officer Network Rail, and Peter Jackson, Head of Data The Pensions Regulator. We’ve talked about the first and second generation CDO’s so what next? We have all heard that the CDO role is just a gimmick that companies are being sold, that won’t actually help them...

The second generation CDO

Authors: Caroline Carruthers, Chief Data Officer Network Rail, and Peter Jackson, Head of Data The Pensions Regulator. A previous article proposed that a second generation CDO turns the ‘possible’ into an art form, ‘understanding the nuances of the family and making the house a home filled with wonder and intelligence’. The...

Why is data visualisation important?

Data makes the business world go around. Informing decisions going forward, the ability to analyse and act on information collated by data is becoming increasingly important to businesses as they’re required to quickly react to changing demands. However, going one step further, data visualisation has become progressively important in the...

First Generation v Second Generation CDO

Authors: Caroline Carruthers, Chief Data Officer Network Rail, and Peter Jackson, Head of Data The Pensions Regulator. Being a Chief Data Officer in the current climate is a rather interesting place to be, it can feel a little like dancing on quicksand while you have to learn to juggle wriggling snakes....

Avoiding the Hype Cycle

Author: Caroline Carruthers, Chief Data Officer at Network Rail Being a Chief Data Officer in the current climate is a rather interesting place to be, it can feel a little like dancing on quicksand while you have to learn to juggle wriggling snakes. So in order to help people interested...

Delivering a Data Strategy in the Cauldron of BAU

Authors: Caroline Carruthers, Chief Data Officer Network Rail, and Peter Jackson, Head of Data The Pensions Regulator. One of the most difficult tasks for the new CDO is developing a Data Strategy whilst the organisation continues to operate (and must continue to operate) using and abusing data, continuing with bad habits...

Chief Data Officer – The first 100 days, part 2

Authors: Caroline Carruthers, Chief Data Officer Network Rail, and Peter Jackson, Head of Data The Pensions Regulator. So what are your ‘information basics’? From the last article we talked about the idea of getting your basics right but left you on a bit of a cliff hanger so thought we could revisit the...

Chief Data Officer – The first 100 days, part 1

Authors: Caroline Carruthers, Chief Data Officer Network Rail, and Peter Jackson, Head of Data The Pensions Regulator. The first 100 days Part 1 Gartner predicted that by 2019, 90% of large organisations will have hired a CDO – but only 50% of these will be a success. Much of what determines...

The Secret Ingredients of the successful Chief Data Officer

Authors: Caroline Carruthers, Chief Data Officer Network Rail, and Peter Jackson, Head of Data The Pensions Regulator. Compared to most of the C-Suite colleagues the CDO is faced with a set of unique problems. There are similarities, the CDO is a subject specialist, and in that respect is similar to the Chief Finance Officer, Chief Investment Officer or...

So why does any organisation need a Chief Data Officer?

Authors: Caroline Carruthers, Chief Data Officer Network Rail, and Peter Jackson, Head of Data The Pensions Regulator So why does any organisation need a Chief Data Officer? If it’s at the right level it is a big investment and they aren’t going to just come on their own, a team of some...

Big Data LDN nominated at EN Awards

Big Data LDN organisers 3rd Street Group are delighted to announce that the event has been nominated in the “Show Rising Star” category for the upcoming 2017 EN Awards. The EN Awards, hosted by Exhibition News, will take place on 30th March 2017 in London.

Big Data vs Small Data

We have entered an age where data is becoming a highly valuable commodity. When managed effectively it can be used to provide intelligent consumer insight and predictive analysis to give a company a competitive edge, improving efficiency, safety and increasing profits on a huge scale. When it comes to forming...

What is data wrangling?

Businesses of the modern age generate huge amounts of data every day and the data gathered continues to grow as more channels for accumulating information emerge. It is becoming increasingly important for businesses to organise and utilise the invaluable tool that is data and data wrangling can support this. In...

Hiring a data scientist, what should you look for?

Data science is the process of extracting knowledge or insights from data. As businesses gather more data from various sources there is becoming a growing demand for data scientists to allow businesses to utilise the information they are gathering but finding the right one in a competitive industry can be...

Big Data – How do you keep it secure?

Big data is a helpful tool for businesses but it does present security risks that firms need to address in order to keep their information and insights secure. Extremely large data sets that have become known as big data are proving to be invaluable tools for businesses worldwide, for both...

What is Analytics as a Service (AaaS)?

If you’re venturing into the world of big data, you may have heard the term Analytics as a Service. If you’re confused by what this actually means, our guide is here to help. The Basics At its most basic AaaS refers to the practise of using Web-based technologies to carry...

Mistakes to Avoid When Using Big Data

Has your company recently decided to make the most of its big data? If so, here are some common mistakes to avoid. Don’t collect data indiscriminately At first, it may be tempting to jump right in and collect data on a whole host of topics without proper thought into how...

Stopping big data becoming bad data

Big data can provide businesses with huge amounts of detailed insight, using information from a wide range of sources not only to solve existing pain points, but also to predict problems in the future and forecast previously unknown opportunities for growth. It comes as no surprise that data is becoming...

What’s next for big data in 2017?

Big data is a hugely valuable tool, helping businesses to improve productivity and performance – allowing them to expand and grow like never before. Big data is now big business around the globe –  but what innovations and changes can you expect to see in the coming year? Expansion It’s...

Why Big Data is useful for every industry

Big Data allows businesses to gather and store large amounts of information for easy analysis. This can be useful for businesses in a myriad of industries, even ones you might not automatically think of. Big Data LDN is committed to helping business understand the benefits of big data, no matter...

More answers, less theory from Big Guns at Big Data LDN

Big Data practitioners unite in London for UK’s first delegate-led independent tech conference London, UK, 1st September 2016 – Big Data LDN, the first delegate-led independent Big Data event in the UK, today launched its 2016 programme. This new event, which is held at Olympia London between November 3rd and...

How to transform data into useful management information

The saying ‘If you can’t measure it, you can’t manage it’ has long been linked to business and management. Big data now means that managers have access to a wealth of information that measures many different aspects of their business operations, customers and employees. While the information is now more...

Why isn’t your business using NoSQL databases yet?

Businesses today are collecting huge amount of data every single day that can be used to benefit the business and its operations. The sheer volume of data that companies now deal with and store on a daily basis means that traditional frameworks are under pressure and in some cases are...

Why businesses are using Big Data for competitive advantage

Data is now an important tool for businesses to utilise, whatever sector they operate in and whether they’re a global company or a small firm. Companies are increasingly using big data to gain a competitive advantage over business rivals but how does it benefit them? Analysing the datasets a business...

Is Your Business Intelligent?

Asking whether your business is intelligent might seem like an unusual question but the response is becoming more important to companies that want to get ahead of rivals and maintain a competitive edge. Business intelligence is a set of techniques or tools used to acquire and transform raw data into...

Announcing Big Data LDN

Two Day Exhibition and Conference Dedicated to Big Data to be Held in London Big Data LDN to be held at Olympia London, 3-4 November 2016 A new free to attend two-day exhibition and conference focusing on how to build dynamic, data-driven enterprises will open its doors at Olympia London...

How To Become A Data-Driven Company

The value of big data can’t be overstated for businesses nowadays. The collection and analysis of data has allowed thousands of businesses to make decisions that are driven by that data, lending their decisions more weight and credibility – and even predicting the future with machine-learning. But how can you...