On the Study of Transformers for Query Suggestion

2022 ◽  
Vol 40 (1) ◽  
pp. 1-27
Author(s):  
Agnès Mustar ◽  
Sylvain Lamprier ◽  
Benjamin Piwowarski
Keyword(s):  
Neural Network ◽  
Search Engine ◽  
Recurrent Neural Network ◽  
Search Task ◽  
User Behavior ◽  
Query Suggestion ◽  
Search Tasks ◽  
Hierarchical Architectures ◽  
Query Suggestions

When conducting a search task, users may find it difficult to articulate their need, even more so when the task is complex. To help them complete their search, search engine usually provide query suggestions. A good query suggestion system requires to model user behavior during the search session. In this article, we study multiple Transformer architectures applied to the query suggestion task and compare them with recurrent neural network (RNN)-based models. We experiment Transformer models with different tokenizers, with different Encoders (large pretrained models or fully trained ones), and with two kinds of architectures (flat or hierarchic). We study the performance and the behaviors of these various models, and observe that Transformer-based models outperform RNN-based ones. We show that while the hierarchical architectures exhibit very good performances for query suggestion, the flat models are more suitable for complex and long search tasks. Finally, we investigate the flat models behavior and demonstrate that they indeed learn to recover the hierarchy of a search session.

Hierarchical Contextual Attention Recurrent Neural Network for Map Query Suggestion

2017 ◽  
Vol 29 (9) ◽  
pp. 1888-1901 ◽  
Author(s):  
Jun Song ◽  
Jun Xiao ◽  
Fei Wu ◽  
Haishan Wu ◽  
Tong Zhang ◽  
...  
Keyword(s):  
Neural Network ◽  
Recurrent Neural Network ◽  
Query Suggestion

scholarly journals An investigation of biases in web search engine query suggestions

2019 ◽  
Vol 44 (2) ◽  
pp. 365-381 ◽  
Author(s):  
Malte Bonart ◽  
Anastasiia Samokhina ◽  
Gernot Heisenberg ◽  
Philipp Schaer
Keyword(s):  
Search Engine ◽  
Search Engines ◽  
Web Search ◽  
Query Suggestion ◽  
Data Set ◽  
Content Type ◽  
Web Search Engine ◽  
The Stability ◽  
Query Suggestions ◽  
Over Time

Purpose Survey-based studies suggest that search engines are trusted more than social media or even traditional news, although cases of false information or defamation are known. The purpose of this paper is to analyze query suggestion features of three search engines to see if these features introduce some bias into the query and search process that might compromise this trust. The authors test the approach on person-related search suggestions by querying the names of politicians from the German Bundestag before the German federal election of 2017. Design/methodology/approach This study introduces a framework to systematically examine and automatically analyze the varieties in different query suggestions for person names offered by major search engines. To test the framework, the authors collected data from the Google, Bing and DuckDuckGo query suggestion APIs over a period of four months for 629 different names of German politicians. The suggestions were clustered and statistically analyzed with regards to different biases, like gender, party or age and with regards to the stability of the suggestions over time. Findings By using the framework, the authors located three semantic clusters within the data set: suggestions related to politics and economics, location information and personal and other miscellaneous topics. Among other effects, the results of the analysis show a small bias in the form that male politicians receive slightly fewer suggestions on “personal and misc” topics. The stability analysis of the suggested terms over time shows that some suggestions are prevalent most of the time, while other suggestions fluctuate more often. Originality/value This study proposes a novel framework to automatically identify biases in web search engine query suggestions for person-related searches. Applying this framework on a set of person-related query suggestions shows first insights into the influence search engines can have on the query process of users that seek out information on politicians.

Improve the Search and Ranking with Neural Networks

2013 ◽  
Vol 441 ◽  
pp. 721-726
Author(s):  
Yu Wen Chen ◽  
Ju Zhang ◽  
Kun Hua Zhong ◽  
Lei Feng Liu ◽  
Yuan Yao
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Search Engine ◽  
Full Text ◽  
Retrieval System ◽  
User Behavior ◽  
Text Retrieval ◽  
Bp Neural Networks ◽  
Ranking System ◽  
Full Text Retrieval

The full text retrieval system can receive constant feedback in the form of user behavior. In the case of a search engine, each user will immediately provide information about how much he likes the results for a given search by clicking on one result and choosing not to click on the others. This paper will look at a way to record when a user clicks on a result after a query, and design a Click-Tracking Network. Then training it with BP neural networks to intelligently improve the rankings of the results for users. Finally, we implement a search and ranking system content-based ranking and improve the search and ranking with neural network. By experiments we have shown good results.

scholarly journals Real Time Prediction of Sclera Force with LSTM Neural Networks in Robot-Assisted Retinal Surgery

2020 ◽  
Vol 896 ◽  
pp. 183-194
Author(s):  
Chang Yan He ◽  
Niravkumar Patel ◽  
Marin Kobilarov ◽  
Iulian Iordachita
Keyword(s):  
Neural Network ◽  
Real Time ◽  
Contact Force ◽  
Recurrent Neural Network ◽  
Short Term Memory ◽  
User Behavior ◽  
Short Term ◽  
Insertion Depth ◽  
Term Memory ◽  
Long Short Term Memory

Retinal microsurgery is one of the most technically demanding surgeries, during which the surgical tool needs to be inserted into the eyeball and is constantly constrained by the sclerotomy port. During the surgery, any unexpected manipulation could cause extreme tool-sclera contact force leading to sclera damage. Although, a robot assistant could reduce hand tremor and improve the tool positioning accuracy, it cannot prevent or alarm the surgeon about the upcoming danger caused by surgeon’s misoperations, i.e., applying excessive force on the sclera. In this paper, we present a new method based on a Long Short Term Memory recurrent neural network for predicting the user behavior, i.e., the contact force between the tool and sclera (sclera force) and the insertion depth of the tool from sclera contact point (insertion depth) in real time (40Hz). The predicted force information is provided to the user through auditory feedback to alarm any unexpected sclera force. The user behavior data is collected in a mock retinal surgical operation on a dry eye phantom with Steady Hand Eye Robot and a novel multi-function sensing tool. The Long Short Term Memory recurrent neural network is trained on the collected time series of sclera force and insertion depth. The network can predict the sclera force and insertion depth 100 milliseconds in the future with 95.29% and 96.57% accuracy, respectively, and can help reduce the fraction of unsafe sclera forces from 40.19% to 15.43%.

Research on behavior recognition based on feature fusion of automatic coder and recurrent neural network

2020 ◽  
Vol 39 (6) ◽  
pp. 8927-8935
Author(s):  
Bing Zheng ◽  
Dawei Yun ◽  
Yan Liang
Keyword(s):  
Neural Network ◽  
Recurrent Neural Network ◽  
Behavior Pattern ◽  
Rapid Development ◽  
Video Data ◽  
Support Vector ◽  
Behavior Recognition ◽  
Learning Methods ◽  
The Impact ◽  
Internet Of Things Technology

Under the impact of COVID-19, research on behavior recognition are highly needed. In this paper, we combine the algorithm of self-adaptive coder and recurrent neural network to realize the research of behavior pattern recognition. At present, most of the research of human behavior recognition is focused on the video data, which is based on the video number. At the same time, due to the complexity of video image data, it is easy to violate personal privacy. With the rapid development of Internet of things technology, it has attracted the attention of a large number of experts and scholars. Researchers have tried to use many machine learning methods, such as random forest, support vector machine and other shallow learning methods, which perform well in the laboratory environment, but there is still a long way to go from practical application. In this paper, a recursive neural network algorithm based on long and short term memory (LSTM) is proposed to realize the recognition of behavior patterns, so as to improve the accuracy of human activity behavior recognition.

Deadlift Recognition and Application based on Multiple Modalities using Recurrent Neural Network

2020 ◽  
Vol 2020 (17) ◽  
pp. 2-1-2-6
Author(s):  
Shih-Wei Sun ◽  
Ting-Chen Mou ◽  
Pao-Chi Chang
Keyword(s):  
Neural Network ◽  
Recurrent Neural Network ◽  
Network Structure ◽  
Inertial Sensors ◽  
Body Movement ◽  
The Body ◽  
Body Parts ◽  
Multimodal Sensing ◽  
Multiple Devices ◽  
Neural Network Structure

To improve the workout efficiency and to provide the body movement suggestions to users in a “smart gym” environment, we propose to use a depth camera for capturing a user’s body parts and mount multiple inertial sensors on the body parts of a user to generate deadlift behavior models generated by a recurrent neural network structure. The contribution of this paper is trifold: 1) The multimodal sensing signals obtained from multiple devices are fused for generating the deadlift behavior classifiers, 2) the recurrent neural network structure can analyze the information from the synchronized skeletal and inertial sensing data, and 3) a Vaplab dataset is generated for evaluating the deadlift behaviors recognizing capability in the proposed method.

Sign in / Sign up

Export Citation Format

Share Document