Sentiment Analysis using Optimized Feature Sets in Different Facebook/Twitter Dataset Domains using Big Data

Now days, in many real life applications, the sentiment analysis plays very vital role for automatic prediction of human being activities especially on online social networks (OSNs). Therefore since from last decade, the research on opinion mining and sentiment analysis is growing with increasing volume of online reviews available over the social media networks like Facebook OSNs. Sentiment analysis falls under the data mining domain research problem. Sentiment analysis is kind of text mining process used to determine the subjective attitude like sentiment from the written texts and hence becoming the main research interest in domain of natural language processing and data mining. The main task in sentiment analysis is classifying human sentiment with objective of classifying the sentiment or emotion of end users for their specific text on OSNs. There are number of research methods designed already for sentiment analysis. There are many factors like accuracy, efficiency, speed etc. used to evaluate the effectiveness of sentiment analysis methods. The MapReduce framework under the domain of big-data is used to minimize the speed of execution and efficiency recently with many data mining methods. The sentiment analysis for Facebook OSNs messages is very challenging tasks as compared to other sentiment analysis because of misspellings and slang words presence in twitter dataset. In this paper, different solutions recently presented are discussed in detail. Then proposed the new approach for sentiment analysis based on hybrid features extraction methods and multi-class Support Vector Machine (SVM). These algorithms are designed using the Big-data techniques to optimize the performance of sentiment analysis

Automatic sentiment analysis of public opinion on nuclear energy

Opinion mining and sentiment analysis based on social media has been developed these years, especially with the popularity of social media and the development of machine learning. But in the community of nuclear engineering and technology, sentiment analysis is seldom studied, let alone the automatic analysis by using machine learning algorithms. This work concentrates on the public sentiment mining of nuclear energy in German-speaking countries based on the public comments of nuclear news in social media by using the automatic methodology, since compared with the news itself, the comments are closer to the public real opinions. The results showed that majority comments kept in neutral sentiment. 23% of comments were in positive tones, which were approximate 4 times those in negative tones. The concerning issues of the public are the innovative technology development, safety, nuclear waste, accidents and the cost of nuclear power. Decision tree, random forest and long short-term memory networks (LSTM) are adopted for the automatic sentiment analysis. The results show that all of the proposed methods can be applied in practice to some extent. But as a deep learning algorithm, LSTM gets the highest accuracy approximately 85.6% with also the best robustness of all.

A Comparative Performance Study of Classification Models for Opinion Mining

Opinion mining has become a major part in today's economy. People would want to know more about a product and the customers opinion before buying it. Companies would also want to know the opinions of the customers. Therefore, analyzing the customer’s opinion is important. A new customer would consider a product as good by analyzing the opinions of other customers. The opinions are collected from various areas, which include blogs, web forums, and product review sites. Classifying these large set of opinions requires a good classifier. In view of this, a comparative study of three classification techniques - Naive Bayes classifier with Kernel Density Estimation (KDE), Support Vector Machine (SVM), Decision Tree and KNN was made. To evaluate the classifier accuracy, precision, recall and F-measure techniques are used. Experimental results show that the Naive Bayes with Kernel Density Estimation (KDE) classifier achieved higher accuracy among others.

A review of a recommendation filtering system approach based on reliable sustainable opinion mining

PurposeIn this article the authors will focus on the state of the art on information filtering and recommender systems based on trust. Then the authors will represent a variety of filtering and recommendation techniques studied in different literature, like basic content filtering, collaborative filtering and hybrid filtering. The authors will also examine different trust-based recommendation algorithms. It will ends with a summary of the different existing approaches and it develops the link between trust, sustainability and recommender systems.Design/methodology/approachMethodology of this study will begin with a general introduction to the different approaches of recommendation systems; then define trust and its relationship with recommender systems. At the end the authors will present their approach to “trust-based recommendation systems”.FindingsThe purpose of this study is to understand how groups of users could improve trust in a recommendation system. The authors will examine how to evaluate the performance of recommender systems to ensure their ability to meet the needs that led to its creation and to make the system sustainable with respect to the information. The authors know very well that selecting a measure must depend on the type of data to be processed and user interests. Since the recommendation domain is derived from information search paradigms, it is obvious to use the evaluation measures of information systems.Originality/valueThe authors presented a list of recommendations systems. They examined and compared several recommendation approaches. The authors then analyzed the dominance of collaborative filtering in the field and the emergence of Recommender Systems in social web. Then the authors presented and analyzed different trust algorithms. Finally, their proposal was to measure the impact of trust in recommendation systems.

Detection of Radicalisation and Extremism Online: A Survey

Introduction: Due to the lack of regulation, the large volume of user-generated online content reflects more closely the offline world than official news sources. Therefore, social media platforms have become an attractive space for anyone seeking independent information. One of the main goals of this work is to clarify concepts such as Extremism and Collective Radicalisation, Social Media, Sentiments/Emotions/Opinions Analysis, as well as the combinations of all of them. Methods: The automatic identification of extremism and collective radicalisation requires sophisticated Natural Language Processing (NLP) methods and resources, especially those dealing with opinions, emotions or sentiment analysis. Text mining and knowledge extraction are also crucial, in particular, directed toward social media and micro-blogging. Results: The present document comprehends a study on theoretical material, focusing on the main concepts of the subject, including the main problems and challenges, from the different areas that compose online radicalisation research. Understanding and detecting extremism and collective radicalism online has a connection to sentiment analysis and opinion mining. There are many barriers to understanding extremism and collective radicalisation; one is to differentiate between who is really engaged in the process and who is just eventually talking about it. Conclusions: The other focus of this work is to find the best ways to identify extremism and collective radicalisation on the internet, using sentiment analysis and focusing on probabilistic methods to create an unsupervised and language-independent approach.

Analyzing Political Polarization on Social Media by Deleting Bot Spamming

Social media platforms are part of everyday life, allowing the interconnection of people around the world in large discussion groups relating to every topic, including important social or political issues. Therefore, social media have become a valuable source of information-rich data, commonly referred to as Social Big Data, effectively exploitable to study the behavior of people, their opinions, moods, interests and activities. However, these powerful communication platforms can be also used to manipulate conversation, polluting online content and altering the popularity of users, through spamming activities and misinformation spreading. Recent studies have shown the use on social media of automatic entities, defined as social bots, that appear as legitimate users by imitating human behavior aimed at influencing discussions of any kind, including political issues. In this paper we present a new methodology, namely TIMBRE (Time-aware opInion Mining via Bot REmoval), aimed at discovering the polarity of social media users during election campaigns characterized by the rivalry of political factions. This methodology is temporally aware and relies on a keyword-based classification of posts and users. Moreover, it recognizes and filters out data produced by social media bots, which aim to alter public opinion about political candidates, thus avoiding heavily biased information. The proposed methodology has been applied to a case study that analyzes the polarization of a large number of Twitter users during the 2016 US presidential election. The achieved results show the benefits brought by both removing bots and taking into account temporal aspects in the forecasting process, revealing the high accuracy and effectiveness of the proposed approach. Finally, we investigated how the presence of social bots may affect political discussion by studying the 2016 US presidential election. Specifically, we analyzed the main differences between human and artificial political support, estimating also the influence of social bots on legitimate users.

Effective Prediction of Online Reviews for Improvement of Customer Recommendation Services by Hybrid Classification Approach

Customers post online product reviews based on their own experience. They may share their thoughts and comments on items on online shopping websites. The sentiment analysis comprises of opinion or idea process and process of sorting high rating reviews according to how well the product satisfies. Opinion mining is a technique for extracting useful data from large amounts of texts in order to use those to enhance or expand a company's operations. According to consumer evaluations, many of the goods aren't as good as they seem. It's common that buyers submit their thoughts on a product but then forget to rate it. The prior data preprocessing is more efficient to extract the features by CNN approach. This proposed methodology breaks down each user's rating prediction model into two parts: one based on the review text and other based on the user rating matrix with the help of CNN feature engineering. The goal of this study is to classify all reviews into ratings by SVM model. This proposed classification model provides good accuracy to predict the online reviews efficiently. For reviews without ratings, a further prediction of feelings is generated using multiple classifiers. The benefits of this proposed model are honed using helpfulness ratings from a small number of evaluations such as accuracy, F1 score, sensitivity, and precision. According to studies using the standard benchmark dataset, the accuracy of customized recommendation services, user happiness, and corporate trust may all be enhanced by including review helpfulness information in the recommender system.

Importance of Big Data and Hadoop in E-Servicing

Consumers are spending more and more time on the web to search information and receive e-services. E-commerce, e-government, e-business, e-learning, e-science, etc. reflect the growing importance of the web in all aspects of our lives. Along with the tremendous growth of online information, the use of big data has become a vital force in growing revenues. Consumers are today shopping multiple products across multiple channels online. This transformation is substantial and many of the e-commerce companies have now turned to big data analytics for focused customer group targeting using opinion mining for evaluating campaign strategies and maintaining a competitive advantage, especially during the festive shopping season. So, the role of intelligent techniques in e-servicing is massive. This chapter focuses on the importance of big data (since there is a large volume of data online) and big data analytics in the field of e-servicing and explains the various applications, platforms to implement the big data applications, and security issues in the era of big data and e-servicing.