Big Data is everywhere in the Retail Industry

Retail and big data

Big Data is everywhere in the Retail Industry. It would be be hard to find any part of the management of retail operations that is not deeply touched by Big Data. In fact, it is already clear that to survive in the Amazon era, all retailers will have to rely heavily on Big data to help them store the right merchandise, at the right times, in the right quantity, and at the right price. Those that ignore it will die.

This does not mean that only the large companies that have the resources to exploit Big Data will thrive while small companies will die. Small companies will be able to harness the power of Big Data – but they are likely to do so through niche consulting firms that have developed the professional and technical skills, hired a stable of experts, built the computing platforms, and acquired access to the massive data required to operate effectively in this field. Smaller retail outfits that buy their services will find them expensive – but the benefits should far outweigh those costs.

The biggest costs will likely not appear on the company’s financial ledger. The biggest costs will be the time, focus, and energy that senior and middle management will need to invest to come to grips with how to leverage Big Data and how to build investment arguments that make sense. This last point proved to be a major stumbling block when general data processing began to make inroads into large and then medium sized companies some 40 years ago. It is quite liable to prove to be a stumbling block in the application of Big Data as well.

Online and Store General Merchandisers

With regards to department stores, the most promising use of Big Data is through recommendation engines.

Recommendation engines — Recommendation engines use the historical purchasing decisions of customers to predict future purchases and recommend other products to customers that they may be interested in. Big Data using these engines have the potential to generate accurate product recommendations to customers before they even leave the webpage. Amazon, for example, sees a 30%-60% revenue uplift due to these recommendations alone. These recommendation engines are a widely-used way of incorporating Big Data into department stores because they are easy to implement and have an immediate positive impact on revenue: recommendation engines are shown to have the potential to boost revenue by 24% on average.

Trend Forecasting — The second biggest use of Big Data in department stores is predicting trends and forecasting demand. Trend forecasting algorithms comb social media and web browsing habits to find what products and services are causing buzz. These algorithms also analyze ads to see what products marketing departments are pushing. The algorithms then compare the data gathered from social media with the data gathered from current ads to accurately predict what the top selling products for a given quarter will be, how to better market products, and how to develop more cost-effective marketing strategies.

These predictive algorithms assist retailers in making better informed decisions about stocking and product ordering. This capability is particularly helpful during the holiday season when shopping rates increase – machine learning can use past historical shopping data to forecast future purchasing and revenue outcomes. It is anticipated that this kind of predictive analysis in department stores will grow from a $2.7 billion global market in 2015 to a $9.2 billion by 2020, a CAGR of around 27%. In the US alone, predictive analysis from big data is expected to reach a $3.6 billion market by 2020. As of 2015, less than 25% of department stores had adopted predictive analytics. Between 2018 and 2020 this is anticipated to grow to 70%.

After identifying trends, Big Data (particularly in regards to customer economic and geographic information) can be used to understand where and when this demand will come from. This helps business to generate effective marketing and advertising campaigns. For example, (Russia’s first online retailer) analyzed that demand for books rises when it gets colder during the winter months, and thus increases the number of book ads their customers see. This ability to accurately forecast demand, that comes with using Big Data, is helpful in lowering a business’s costs, as it is expensive to keep excess inventory on shelves and having too little stock drives down revenue and decreases customer engagement and loyalty.

Price Optimization — The third main use for big data in department store retail is optimizing pricing. In retail, Big Data can be used to help assist in determining when prices should be dropped (marked down optimization) or when they can be raised without customer dissatisfaction (reflected by a lack or reluctance to purchase). Previously, before the advent of Big Data, markdowns occurred at the end of the buying season, with stores hugely discounting their remaining merchandise. The problem with this approach is that demand is already gone by the time that markdowns occur. Big Data analytics demonstrate that what is actually most effective in increasing revenues is to gradually lower prices once demand initially begins to decrease. When the US retailer Stage Stores employed this technique, it could increase its traditional end of season sales revenue over 90% of the time.

Weather Optimization — Big Data is particularly helpful in optimizing prices in accordance with weather conditions. The Weather Company (part of IBM) has found that “weather is one of the largest swing factors for economic and business performance” – 60% of shoppers change their behaviors when it is either raining or it is hotter than average out. A 1o F drop in temperatures below 60o produces a 2%-3% drop in apparel sales. Approximately 60%-70% of a retailer’s excess expenses are due to weather-impacted supply chain costs (e.g., trucks held up due to poor weather conditions). In the UK, if temperatures reach over 65o F there is a 22% rise in fizzy drink sales, a 20% rise in juice sales, and a 90% rise in lawn furniture sales. In the US, temperatures below 64o F increase sales in soup, porridge, and lip care. Food, drink, pharmaceutical, and apparel sales are the categories most impacted by weather.

Targeting Individual Consumers — The final use of Big Data in general retail is identifying individual customers and how to most effectively market to and target them specifically – whether through email, text, or location-based alerts. Retailers, for example, can install sensors in their stores to identify customers’ locations through their smartphones. If a customer’s smartphone’s WiFi is turned on, it will attempt to connect with the store’s internet and this is how a customer’s location can be sensed and tracked. Retailers can then track what specific stores she visited, what departments she visited, and what products she purchased at what time and on what date. This information can be used to better understand each customer’s movements and patterns when it comes to shopping. Retailers can then use this information to reorganize their stores to optimize customers’ shopping experience and even to offer special deals and coupons to bring further business to their stores.

General Online Retailers

In addition to the Big Data applications listed above, there are four other applications that apply specifically to online retailers.

Dynamic Pricing — Dynamic pricing is Big Data at its finest. Dynamic pricing is highly responsive to external factors such as consumer demand and competitors’ prices. Dynamic pricing collects trend data about which products are being bought to automatically adjust prices. Its analytic capabilities slowly increase prices on items that are popular and discounts prices on items that are less popular. Dynamic pricing is key to increasing online retailers’ overall revenue.

Individual Customer Experience — Big Data analysis gives sellers insights about customer behavior and demographics and provides customers a personalized experience. For instance, customer data can be used to create buyer-specific e-mails for promotional campaigns. For example,  Amazon’s “Customers who bought this item also bought…” recommendation feature increased sales nearly 30% when it was first implemented. This is a simple and remarkably effective way to keep customers on a retail site and keep them buying. Consumers might have reservations about their favorite retailers knowing intimate details about their lives, but they’re going to love the results in practice. Sharing all those personal tidbits is helping companies like CNA identify fraud and prevent customers from having their identities compromised. Retailers can use information from live transactions and other sources (such as social feeds and geo data from apps) to prevent credit card fraud in real time.

Better Quality of ProductsAmazon is the e-commerce standard when it comes to smart, effective pricing. It can easily access its competitors’ pricing data and respond quickly with its own deals — changing some items’ prices up to 10 times a day. The industry-wide shift to dynamic pricing means that companies will no longer be competing on price alone. They will now need to establish a reputation for offering their customers the best value and the best experience.

Reduce incidents of shopping cart abandonment — Companies can also use cross-device tracking to reduce shopping cart abandonment rates. EBay research found that the average consumer uses as many as three or five devices or platforms during the course of her buying journey. Mapping this journey with data allows retailers to help their customers’ transition from one device to the next and complete their purchases.

Big Data is transforming the Auto Industry

Big Data in Auto Industry

The next few years are going to see an explosion in the rate at which detailed data is collected about the moment-by-moment operation of nearly all new cars. This data will be stored and collated in centralized databases that make Big Data analyses possible. McKinsey published a report in 2014 that estimated that the global market for connectivity components and services for cars was $38 billion that year. The report went on to project that the data-driven connected car industry would grow to $215 billion.

Big Data Will Transform Fleet Management

Fleet management will enjoy the greatest benefit from this Big Data analysis. Auto makers will now be able to determine which settings and features drivers actually use. This will help them improve their marketing. It will also identify the features that drivers really care about; this will focus the auto makers’ on-going R&D efforts.

Further, automakers can easily monitor their cars, identify potential problems, and issue maintenance calls. This will help maintain their fleets in peak performance. They will be able to identify drivers who are abusing their cars; they can issue advisories based on that information. All of these efforts are geared to minimizing the maintenance costs and maximizing the performance of their fleets.

Big Data Is Transforming At least Five Other Auto Practices

City Planning — City planners and engineers can use this same data to improve their plans for roadways and traffic flows.

Onboard Navigation — Navigation systems can use real time driving data to discover and display the fastest routes based on current traffic patterns.

Insurance Rates — Insurance companies can access the Big Data collected from connected cars to monitor each driver’s performance and, potentially, use this information to adjust rates and to determine what really happened in accidents.

Auto Dealer Marketing Campaigns — Dealers can use this Big Data to assist in planning their marketing campaigns. For example, Bullseye Prospecting is a product that helps dealers and their marketing agencies automate their marketing campaigns by leveraging third party and internal data on consumer behavior, incentives, and vehicle equity/valuation. This prospecting tool can cut the $600-$800 average per-car cost of sale by about 30%. It also helps dealers by sending a detailed, personalized message to their best customers at precisely the right time to prompt sales and services.

Used Car Valuations and Inventory Management — The 2016 Black Book survey indicated that nearly two-thirds of dealers are using 30%-50% more data since 2014 to establish vehicle valuations. This data also helps them set regional pricing, determine the appropriate supply of cars, and assess each vehicle’s history to manage their inventories. Some 69% of these dealers say the data is giving them better insights on pricing and profitability. 58% say Big Data is providing better insight into managing their inventory procurement. The majority of dealers believe they can avoid a market catastrophe similar to the one in 2008 because the data allows them to make more accurate decisions.