﻿<?xml version="1.0" encoding="utf-8"?>
<ArticleSet>
  <ARTICLE>
    <Journal>
      <PublisherName>مرکز منطقه ای اطلاع رسانی علوم و فناوری</PublisherName>
      <JournalTitle>Journal of Information Systems and Telecommunication (JIST) </JournalTitle>
      <ISSN>2322-1437</ISSN>
      <Volume>14</Volume>
      <Issue>54</Issue>
      <PubDate PubStatus="epublish">
        <Year>2026</Year>
        <Month>9</Month>
        <Day>9</Day>
      </PubDate>
    </Journal>
    <ArticleTitle>Optimization of Hyperparameters of BERT Model in Sentiment Analysis Using Genetic Algorithm</ArticleTitle>
    <VernacularTitle>Optimization of Hyperparameters of BERT Model in Sentiment Analysis Using Genetic Algorithm</VernacularTitle>
    <FirstPage>99</FirstPage>
    <LastPage>116</LastPage>
    <ELocationID EIdType="doi" />
    <Language>en</Language>
    <AuthorList>
      <Author>
        <FirstName>Shahla</FirstName>
        <LastName>Sadeghani</LastName>
        <Affiliation></Affiliation>
      </Author>
      <Author>
        <FirstName>Mohammad jafar</FirstName>
        <LastName>Tarokh</LastName>
        <Affiliation>K.N. Toosi University of Technology</Affiliation>
      </Author>
      <Author>
        <FirstName>Mohammad Ali</FirstName>
        <LastName>Afshar Kazemi</LastName>
        <Affiliation> Islamic Azad University</Affiliation>
      </Author>
    </AuthorList>
    <History PubStatus="received">
      <Year>2025</Year>
      <Month>9</Month>
      <Day>19</Day>
    </History>
    <Abstract>&lt;p&gt;Sentiment analysis, a vital branch of natural language processing (NLP), is progressing rapidly, and advanced models such as BERT are used to improve the accuracy of such analyses. However, tuning BERT&amp;rsquo;s hyperparameters remains a major challenge, directly influencing its performance. The methods used in previous research to optimize hyperparameters often face limitations in accuracy and efficiency. This study addresses an important research knowledge gap by using genetic algorithm (GA) to present a new approach to optimize the hyperparameters of BERT model in sentiment analysis with the main goal to get better results. In this regard, this research is designed analytically and experimentally. Data were collected through Twitter API and preprocessed using NLP techniques including noise removal, tokenization, and text normalization before being analyzed.&amp;nbsp; The BERT model&amp;rsquo;s hyperparameter optimization was performed using GA and the optimized models were evaluated based on criteria such as accuracy, precision, recall and F-1 score.&amp;nbsp; The proposed algorithm was compared with other common methods such as vanilla BERT, Long Short-Term Memory (LSTM) and convolutional neural network (CNN). The results showed that the proposed model has significantly better performance than other methods, achieving 98.1% accuracy, 98.2% precision, 98.1% recall, 98.15% F-1 score, and an area under the curve (AUC) of 98.5%. In comparison, vanilla BERT model, LSTM and CNN scored 92.8%, 91.3% and 90.5% in accuracy, respectively. These results indicate that the use of GA in optimizing the hyperparameters of BERT model can effectively increase the accuracy and efficiency of sentiment analysis. This approach not only has applicability in various fields of text data analysis, but also can be used as an effective solution for future research in optimizing deep learning models.&lt;/p&gt;</Abstract>
    <ObjectList>
      <Object Type="Keyword">
        <Param Name="Value">Sentiment Analysis</Param>
      </Object>
      <Object Type="Keyword">
        <Param Name="Value">BERT</Param>
      </Object>
      <Object Type="Keyword">
        <Param Name="Value">Genetic Algorithm</Param>
      </Object>
      <Object Type="Keyword">
        <Param Name="Value">Hyperparameter Optimization</Param>
      </Object>
    </ObjectList>
    <ArchiveCopySource DocType="Pdf">http://jist.ir/en/Article/Download/51529</ArchiveCopySource>
  </ARTICLE>
</ArticleSet>