--- title: "Data Mining: Social Media vs. Online Communities" description: Both social media and online insight communities are valuable sources of customer information. But which is best suited to mining data from and what are the implications? image: https://blog.flexmr.net/hubfs/Data%20Mining%20vs%20Online%20Communities%20Image.png --- close ## Ready to level up your insights? Get ready to streamline, scale and supercharge your research. Fill out this form to request a demo of the InsightHub platform and discover the difference insights empowerment can make. A member of our team will reach out within two working days. close ## Cost effective insights that scale Quality insight doesn't need to cost the earth. Our flexible approach helps you make the most of research budgets and build an agile solution that works for you. Fill out this form to request a call back from our team to explore our pricing options. [![FlexMR logo](https://www.flexmr.net/skin/images/images-custom/2b221b67-b091-4584-9017-872ee2ddf960-logo.svg)](https://www.flexmr.net/) Book a Demo Request Pricing [Contact Us](https://www.flexmr.net/contact/) Menu - [Home](https://www.flexmr.net/) - [InsightHub](https://www.flexmr.net/insighthub/) - [What is InsightHub?](https://www.flexmr.net/insighthub/) - [Data Collection](https://www.flexmr.net/insighthub/data-collection/) - [Data Analysis](https://www.flexmr.net/insighthub/data-analysis/) - [Data Activation](https://www.flexmr.net/insighthub/data-activation/) - [Research Templates](https://blog.flexmr.net/topic/survey-templates/) - [Information Security](https://www.flexmr.net/insighthub/information-security/) - [Services](https://www.flexmr.net/services/) - [Our Expert Services](https://www.flexmr.net/services/) - [Support & Education](https://www.flexmr.net/services/support-and-education/) - [Consultative Services](https://www.flexmr.net/services/consultative-services/) - [Insight Delivery](https://www.flexmr.net/services/insight-delivery-services/) - [Research Methods](https://www.flexmr.net/methods/) - [Sectors We Work With](https://www.flexmr.net/sectors/) - [About](https://www.flexmr.net/about/) - [About Us](https://www.flexmr.net/about/) - [Leadership](https://www.flexmr.net/about/leadership/) - [Meet the team](https://www.flexmr.net/about/meet-the-team/) - [Advisory Board](https://www.flexmr.net/about/advisory-board/) - [Press & Media](https://resources.flexmr.net/tag/press) - [Accolades](https://www.flexmr.net/about/accolades/) - [Careers](https://www.flexmr.net/about/careers/) - [Blog](https://blog.flexmr.net/) - [Resources](https://resources.flexmr.net) - [Contact](https://www.flexmr.net/contact/) - [Book a Demo](https://blog.flexmr.net/) - [Request Pricing](https://blog.flexmr.net/) - [Home](https://www.flexmr.net/) - [InsightHub](https://www.flexmr.net/insighthub/) - - [What is InsightHub?](https://www.flexmr.net/insighthub/) - [Data Collection](https://www.flexmr.net/insighthub/data-collection/) - [Data Analysis](https://www.flexmr.net/insighthub/data-analysis/) - [Data Activation](https://www.flexmr.net/insighthub/data-activation/) - [Research Templates](https://blog.flexmr.net/topic/survey-templates/) - [Information Security](https://www.flexmr.net/insighthub/information-security/) - ![Camp InsightHub](https://blog.flexmr.net/hubfs/Website_Files/Images/Navigation/camp_insighthub_nav.png) Embark on a new adventure. Join Camp InsightHub, our free demo platform, to discover the future of research. [Sign Up Today](https://insighthub.flexmr.net/users/new) - ![FlexMR InsightHub](https://blog.flexmr.net/hubfs/Website_Files/Images/Navigation/insighthub_screenshot.png) Read a brief overview of the agile research platform enabling brands to inform decisions at speed in this PDF. [Download Brochure](https://blog.flexmr.net/hubfs/Public_Files/InsightHub_Brochure.pdf) - ### InsightHub on the Blog - [Surveys, Video and the Changing Face of Agile Research](https://blog.flexmr.net/surveys-video-changing-agile-research) - [Building a Research Technology Stack for Better Insights](https://blog.flexmr.net/research-technology-stack) - [The Importance of Delegation in Managing Insight Activities](https://blog.flexmr.net/delegation-importance-insight-activities) - [Common Insight Platform Pitfalls (and How to Avoid Them)](https://blog.flexmr.net/platform-pitfalls-how-to-avoid-them) - [Services](https://www.flexmr.net/services/) - - [Our Expert Services](https://www.flexmr.net/services/) - [Support and Education](https://www.flexmr.net/services/support-and-education/) - [Consultative Services](https://www.flexmr.net/services/consultative-services/) - [Insight Delivery Services](https://www.flexmr.net/services/insight-delivery-services/) - [Research Methods](https://www.flexmr.net/methods/) - [Sectors We Work With](https://www.flexmr.net/sectors/) - ![FlexMR Services Team](https://blog.flexmr.net/hubfs/Website_Files/Images/Navigation/services.jpg) Our services drive operational and strategic success in challenging environments. Find out how. [Download Brochure](https://blog.flexmr.net/hubfs/Public_Files/Brochures/FlexMR_Services_Brochure.pdf) - ![Video Close Connection Programme](https://blog.flexmr.net/hubfs/Website_Files/Images/Navigation/video_services.jpg) Close Connections bring stakeholders and customers together for candid, human conversations. [Read Press Release](https://resources.flexmr.net/close-connections-launch) - ### Explore our Practices - [Communities Practice](https://www.flexmr.net/insighthub/) - [Closeness Practice](https://www.flexmr.net/practices/customer-closeness/) - [CX Practice](https://www.flexmr.net/practices/customer-experience/) - [Insight Communications Practice](https://www.flexmr.net/practices/insight-communications/) - [About](https://www.flexmr.net/about/) - - [About Us](https://www.flexmr.net/about/) - [Leadership](https://www.flexmr.net/about/leadership/) - [Meet the Team](https://www.flexmr.net/about/meet-the-team/) - [Advisory Board](https://www.flexmr.net/about/advisory-board/) - [Press & Media](https://resources.flexmr.net/tag/press) - [Accolades](https://www.flexmr.net/about/accolades/) - [Careers](https://www.flexmr.net/about/careers/) - ![FlexMR Credentials Deck](https://blog.flexmr.net/hubfs/Website_Files/Images/Navigation/flexmr_credentials.png) The FlexMR credentials deck provides a brief introduction to the team, our approach to research and previous work. [Download Credentials](https://blog.flexmr.net/hubfs/Public_Files/Brochures/FlexMR_Credentials.pdf) - ![FlexMR Insights Empowerment](https://blog.flexmr.net/hubfs/Website_Files/Images/Navigation/insights_empowerment.png) We are the insights empowerment company. Our framework addresses the major pressures insight teams face. [Download Brochure](https://blog.flexmr.net/hubfs/Public_Files/Brochures/Insights_Empowerment_Brochure.pdf) - ### Latest News - [Insight as Art Shortlisted for AURA Innovation Award](https://resources.flexmr.net/aura-innovation-award-2021) - [FlexMR Launch Video Close Connection Programme](https://resources.flexmr.net/close-connections-launch) - [VideoMR Analysis Tool Added to InsightHub](https://resources.flexmr.net/videomr-launch) - [FlexMR Makes Shortlist for Quirks Research Supplier Award](https://resources.flexmr.net/quirksmr-mr-supplier-award-2020) - [Blog](https://blog.flexmr.net) - - [Latest Posts](https://blog.flexmr.net) - [Strategic Thinking](https://blog.flexmr.net/topic/strategic-thinking) - [Technology & Trends](https://blog.flexmr.net/topic/tech-trends) - [Research Methods](https://blog.flexmr.net/topic/research-methods) - [Practical Application](https://blog.flexmr.net/topic/practical-application) - [Insights Empowerment](https://blog.flexmr.net/topic/insights-empowerment) - [View Full Blog Archives](https://blog.flexmr.net/all) - ![FlexMR Close Connection Programme](https://blog.flexmr.net/hubfs/Website_Files/Images/Navigation/close_connection.png) Discover how to build close customer connections to better support real-time decision making. [Build Connections](https://blog.flexmr.net/practical-support-real-time-decisions) - ![Market Research Playbook](https://blog.flexmr.net/hubfs/Website_Files/Images/Navigation/market_research_playbook.png) What is a market research and insights playbook, plus discover why should your team consider building one. [Discover Playbooks](https://blog.flexmr.net/market-research-playbook) - ### Featured Posts - [Five Strategies for Turning Insight into Action](https://blog.flexmr.net/5-strategies-turn-insights-into-action) - [How to Design Surveys that Ask the Right Questions](https://blog.flexmr.net/effective-survey-design-guide) - [Scaling Creative Qual for Rich Customer Insight](https://blog.flexmr.net/scale-creative-qual-rich-understanding) - [How to Measure Brand Awareness: The Complete Guide](https://blog.flexmr.net/measure-brand-awareness) - [Resources](https://resources.flexmr.net) - - [All Resources](https://resources.flexmr.net) - [Client Stories](https://resources.flexmr.net/tag/case-studies) - [Whitepapers](https://resources.flexmr.net/tag/whitepapers) - [Events & Webinars](https://resources.flexmr.net/tag/events) - [The Open Ideas Panel](https://ideas.flexmr.net/auth/sign_in) - [InsightHub Help Centre](https://help.flexmr.net/en) - [FlexMR Client Network](https://www.linkedin.com/groups/9165407/) - ![Insights Empowerment Readiness Calculator](https://blog.flexmr.net/hubfs/Website_Files/Images/Navigation/insights_calculator.png) The insights empowerment readiness calculator measures your progress in building an insight-led culture. [Get Your Score](https://resources.flexmr.net/insights-empowerment-calculator) - ![MRX Lab Podcast](https://blog.flexmr.net/hubfs/Website_Files/Images/Navigation/flexmr_podcast.png) The MRX Lab podcast explores new and novel ideas from the insights industry in 10 minutes or less. [Listen Now](https://resources.flexmr.net/mrx-lab-podcast) - ### Featured Stories - [Specsavers Informs Key Marketing Decisions with InsightHub](https://resources.flexmr.net/specsavers) - [The Coventry Panel Helps Maintain Award Winning CX](https://resources.flexmr.net/coventry-building-society) - [Isagenix Customer Community Steers New Product Launch](https://resources.flexmr.net/isa-insights) - [Curo Engage Residents with InsightHub Community](https://resources.flexmr.net/curo) - [Tech & Trends](https://blog.flexmr.net/topic/tech-trends) / - [Research Methods](https://blog.flexmr.net/topic/research-methods) / 8 MIN READ ## Data Mining: Social Media vs. Online Communities #### Emily James # [Workshops and Beacons: A Guide to Building Custome...](https://blog.flexmr.net/workshops-beacons-customer-salience) Most organisations are not short of data, insight or decks.Their biggest challenge is not whether cu... [Read more](https://blog.flexmr.net/workshops-beacons-customer-salience) 9 MIN READ #### Ed Hill - [Events (1)](https://blog.flexmr.net/topic/events) - [Insights Empowerment (38)](https://blog.flexmr.net/topic/insights-empowerment) - [Practical Application (178)](https://blog.flexmr.net/topic/practical-application) - [Research Methods (285)](https://blog.flexmr.net/topic/research-methods) - [Strategic Thinking (232)](https://blog.flexmr.net/topic/strategic-thinking) - [Survey Templates (7)](https://blog.flexmr.net/topic/survey-templates) - [Tech & Trends (397)](https://blog.flexmr.net/topic/tech-trends) Neither social media nor online research communities are new platforms for businesses to communicate with consumers over. Still, there is no denying that social media has grown in recent years. And it’s offering a huge variety of new data mining possibilities. As Rebecca Carson [states](https://greenbookblog.org/2016/10/27/the-evolution-of-market-research-mining-social-consumer-market-insights/), social media is “breaking the boundaries of data extraction by revealing the powerful insights social listening and analytics provides for brands.” Social media is clearly an extremely valuable source for raw, unfiltered, consumer data just waiting to be taken advantage of by businesses looking to better align themselves to consumer needs. However online communities can act in a similar way and are set up for the express purpose of gathering information for analysis. So which is the better platform to data mine? Social media or online communities? | ![Tweet from FlexMR](https://www.flexmr.net/images/webpage-images/45-tweet-this-from-flexmr.png) | ***Tweet This*** | | --- | --- | | [Social media is clearly an extremely valuable source for raw. unfiltered. consumer data just waiting to be taken advantage of by businesses looking to better align themselves to consumer needs. ](https://ctt.ac/r4ddz) | | ### Mining Social Media Data mining is a fantastic tool that can extract predictive knowledge from this readily available source of consumer insight. One [study](https://www.sciencedirect.com/science/article/pii/S0148296316000813) into the topic of data mining in social media stated that it enabled the researchers to “predict the impact of an individual published post” and allow businesses to “\[tailor\] the promotion of products and services more.” Making the most of every post boosts profits according to this study, since the predictions help brands alter each post to be more impactful on the intended audience. Because these posts are the first point of contact with many potential customers, increasing public awareness initially via promotions and reviews posted to social media channels will intrigue consumers and entice them to find out more about the company and the other products. While this approach is fairly basic, it can be extremely impactful on the bottom line. There have been a few notable resources on how to mine the information from social media for the sake of social intelligence within a business. Sandra Gittlen’s article on [CIO](https://www.cio.com/article/3210707/social-business/social-intelligence-how-to-mine-social-media-for-business-results.html) really delves into how social media can be used to inform marketing decisions and boost a company’s sales or brand awareness. This is a very useful result of data mining in social media and one that Gittlen thinks many brands don’t take advantage of as much as they could. Data mining identifies profitable opportunities that might not be obvious at first glance and also provide conclusions that minimise the risk factor within certain campaigns or promotions. Through discussions, review pages, and general posts about to the company in question, data mining provides the researcher with the ability to identify comprehensible patterns of information from social media activity. Through this one system of information analysis companies can be more reliant on the information gathered and results provided since the data collected is from a source that provides direct contact with the views of consumers. The main technique of collecting this data for the purposes of data mining is called scraping. Web scraping automates how a human would go through and collect information on the internet, which can then be analysed for the purposes of market research. There are rules on social media and other websites about when and what can be scraped. These rules can be found by typing in the website name, for example ‘facebook.com’, and then adding ‘/robot.txt’ to the end of the URL. This will display the rules and regulations for scraping that particular website. However, since the Cambridge Analytics Scandal in March of this year, general data protection regulations have been significantly tightened, making it harder for companies to gather the large-scale amount of data desired from social media. | ![Tweet from FlexMR](https://www.flexmr.net/images/webpage-images/45-tweet-this-from-flexmr.png) | ***Tweet This*** | | --- | --- | | [General data protection regulations have been significantly tightened. making it harder for companies to gather the large-scale amount of data desired from social media.](https://ctt.ac/snmyJ) | | ### Mining Online Communities One major difference when scraping information from social media and online communities is consent. Since the Cambridge Analytica scandal, Facebook has set regulations so that you can only scrape public (and private by individual consent) data at certain times of the day when the traffic isn’t as high; this means that the data collected is consensual and at a time when it won’t impact the performance of the social media channel. Due to the many issues surrounding consent, this is where online communities come in to their prime. There are different tools which create an online community on a market research platform. Our own include BlogsMR, SocialMR, and ForumsMR. When added to a platform, these tools enable users to interact with each other similarly to how they do on a social media platform, only this time with a guiding purpose. Users know they are being monitored and they know they are here specifically to give insight into a company or a specific product. In terms of online discussions, insight communities and other collaborative conversation tools, data mining allows researchers to analyse a large amount of data gathered from a customised online community. This way, researchers can pick who their target audience are and invite recipients that fit the criteria to take part in the research. Researchers will then be able to ask the invited audience members questions about their perceptions and wants, and instead of trawling through that data, the data mining tool will pick up on the key words and trends in all of their answers. Within forums and blogs, participants have more free reign, but because it will be on a dedicated research platform, the likelihood is that these discussions will still be on relevant topics. Participants may even come up with questions that were not in the initial scope, perfect for passive data gathering. ### Which platform is best for data mining? Social media minimises participant involvement, which could be a both a benefit and a hindrance. With this in mind it is possible to reach customers who might not normally take the time to participate in online communities. This opens up data that may not have otherwise been available. However, it is also possible to gather lots of data that isn’t relevant to the research goal. It’s also possible to use social media to advertise market research opportunities and therefore as a community building tool. Online communities allow researchers to customise audiences and questions. Online communities also maximise participant involvement, meaning researchers definitely have their, but also the sample bias of those who are willing to participant. Mining the information from both platforms is definitely possible. However this approach produces a lot of data to interpret and many of influences to factor in. It might just be worth it depending on how much data is required. ### Conclusion Social media and online communities both have their pros and cons, and picking which platform to use primarily is heavily dependent on marketing needs. However I believe that it would be unwise to pick one and discard the other completely, since they are both very valuable sources of information in their own way. While one platform may have more benefits for your marketing needs, mining both platforms will give you a good set of data that will cover all bases. #### About FlexMR We are The Insights Empowerment Company. We help research, product and marketing teams drive informed decisions with efficient, scalable & impactful insight. #### About Emily James As a professional copywriter, Emily brings our global vision to life through a broad range of industry-leading content. #### Stay up to date ## You might also like... ![Blog Featured Image Header](https://blog.flexmr.net/hubfs/Marketing_Files/Blogs/Headers/retaining_human_touch_customer_salience_cx_ai.png) ### [Retaining a Human Touch with Custom...](https://blog.flexmr.net/customer-salience-cx-ai) In recent years, companies have embraced artificial intelligence (AI) at pace, swept up in a technological momentum that promises efficiency and cost savings. However, in their rush to pursue quickly ... [Continue reading](https://blog.flexmr.net/customer-salience-cx-ai) 5 MIN READ ![Blog Featured Image Header](https://blog.flexmr.net/hubfs/Marketing_Files/Blogs/Headers/casual_conversation_iosetta_santini.png) ### [A Casual Conversation... with Ioset...](https://blog.flexmr.net/casual-conversation-iosetta-santini) Most research projects still currently end with a powerpoint report and a debrief. This has become deeply entrenched as the industry standard, and it is what stakeholders have come to expect when they... [Continue reading](https://blog.flexmr.net/casual-conversation-iosetta-santini) 4 MIN READ ![Blog Featured Image Header](https://blog.flexmr.net/hubfs/Marketing_Files/Blogs/Headers/synthetic_data_richer_market_insights.png) ### [Synthetic Data: The Key to Richer M...](https://blog.flexmr.net/synthetic-data-richer-market-insights) In the dynamic world of market research, the need for robust and accurate data is critical. Whilst the increased prevalence of generative AI has provided a range of benefits to market research process... [Continue reading](https://blog.flexmr.net/synthetic-data-richer-market-insights) 7 MIN READ ![](https://www.flexmr.net/skin/images/images-custom/48f118ee-cef9-42d6-b60b-5575d5ac26e3-flexmr_footer.svg) - [Home](https://www.flexmr.net/) - [Contact Us](https://www.flexmr.net/contact/) - [Privacy Policy](https://www.flexmr.net/legal/privacy/) - [Cookie Policy](https://www.flexmr.net/legal/cookies/) - [Terms of Use](https://www.flexmr.net/legal/terms-of-use/) [Follow us on Facebook](https://www.facebook.com/flexmr/) [Follow us on Twitter](https://twitter.com/_flexmr) [Follow us on LinkedIn](https://www.linkedin.com/company/flexmr) [Follow us on YouTube](https://www.youtube.com/c/FlexmrNetOnlineResearch) [![Grit Top 50 Logo](https://www.flexmr.net/uploads/photo-gallery-include-images/34/44258f4d-7452-40d6-bb23-0e220c8ba21f.png)](https://www.greenbook.org/mr/grit/business-innovation-edition) [![ISO 27001 Alcumus](https://www.flexmr.net/uploads/photo-gallery-include-images/34/fa89f9b3-d866-43b8-8de0-4a052a9053d8.png)](https://www.alcumus.com/en-gb/certification/iso-27001/) [![Cyber Essentials Plus Logo](https://www.flexmr.net/uploads/photo-gallery-include-images/34/cba57df6-75a2-4544-9599-dcc0c2f14b79.png)](https://blog.flexmr.net/hubfs/Public_Files/Other/FlexMR_Cyber_Essentials_Certificate.pdf?__hstc=163229475.dde2c3d212762f49b059c9f62e7537a0.1624542718433.1626339489304.1626701624468.7&__hssc=163229475.2.1626701624468&__hsfp=3142549060) © FlexMR 2021. All rights reserved. ```json { "@context" : "https://schema.org", "@type" : "BlogPosting", "author" : { "@type" : "Person", "name" : "Emily James", "url" : "https://blog.flexmr.net/author/emily-james" }, "dateModified" : "2021-07-22T10:12:59.726Z", "datePublished" : "2018-09-03T10:46:46.000Z", "headline" : "Data Mining: Social Media vs. Online Communities", "image" : [ "https://blog.flexmr.net/hubfs/Data%20Mining%20vs%20Online%20Communities%20Image.png" ], "mainEntityOfPage" : { "@id" : "https://blog.flexmr.net/data-mining-market-research", "@type" : "WebPage" }, "publisher" : { "@type" : "Organization", "logo" : { "@type" : "ImageObject", "url" : "https://blog.flexmr.net/hubfs/Website_Files/Images/Logos/flexmr_logo_amp.png" }, "name" : "FlexMR" } } ```