Retail industry is witnessing rapid change as more and more players embrace online channels to widen their customer base and drive revenue. Working across multiple channels, online and offline retailers are looking to provide customers with individualized offers, delivered anytime, anywhere and on any device. Recent reports suggest mega trends like big data, social media, mobility, and analytics are significantly shaping the retail landscape.


Retailers deal with a highly informed breed of digital consumers who leverage technology for affordable offerings, which are easy to order and delivered at the place and time that the customer finds most convenient. For instance, some retailers allow customers to place orders simply by scanning the quick response (QR) codes of the merchandise they need on a smartphone. The goods are delivered a short while after the consumers get home from work, not earlier, not later. Convenience isn't enough; new-age consumers look for personalized marketing that is strictly tailored to their need.


Retailers must build the big picture of their customers, containing details of their buying history, age, marital status, salary, lifestyle, habits, and more before they can deliver on the personalization mandate. This is where big data comes in handy by providing a massive pool of granular data on customers from across touch points in the retail organization, which can help the retailer gain a competitive advantage in the market. While that sounds pretty cool on the surface, there are hidden problems in accessing big data. Traditionally, the major part of the data retailers use is structured data, which is easily captured, queried and analyzed. All that is changing with the high-volume of largely unstructured data flooding the organization at an unprecedented speed, that too in every conceivable format – email, blog post, audio, video, phone calls and social media postings. This is popularly described as "big data." The volume of this data is set to grow 800 percent over next 5 years and 80 percent of this will reside as unstructured data, says a recent report by Gartner. Processing this assortment of data is going to require considerable time and effort.


Big data has the potential to help retailers get inside knowledge of customers, including their buying trends, location, age as well as implement targeted marketing campaigns. Targeting niche groups of like-minded individuals is the new rage. Last year, as part of a micro targeting initiative, a multinational grocery sent a £5 discount offer to women aged 25 to 54 living in the catchment areas of its stores. Nearly 40,000 women clicked on a single day to redeem the coupon from the store. In another campaign a few months later, the top-end retailer sent mobile messages to people within the proximity of its stores, gently reminding them to order their turkey early enough for Christmas. Apart from improving operations and overall merchandising, tapping into rich stores of big data enables retailers to present customers with real-time location-based offerings like in the example above, which are also highly relevant. While big data is a blessing, there are challenges in getting the most value out of big data pileups within retail organizations. First of all, for the most part, the data is all over the place – in spreadsheets, databases, and apps, and, of course, between the ears (of people). Effective metadata management can help in cataloging this flood of data and making it more understandable and accessible for business users.