BenCoDiC：面向孟加拉语政治新闻话语的大规模语境化网络欺凌语料库 完整版

# A Large-Scale Contextual Cyberbullying Corpus for Bengali Political News Discourse—FULL VERSION
Source: [https://arxiv.org/html/2610.13121](https://arxiv.org/html/2610.13121)
Rudra Pratap Deb NathUmme SalmaShima Chakrabortyand Md\. Hanif Seddiqui††thanks:Md\. Nesarul Hoque is with the Big Data, Information and Knowledge Engineering Lab, Department of Computer Science and Engineering, University of Chittagong, Chattogram\-4331, Bangladesh, and also with the Department of Computer Science and Engineering, Gopalganj Science and Technology University, Gopalganj\-8105, Bangladesh\.††thanks:Rudra Pratap Deb Nath, Shima Chakraborty, and Md\. Hanif Seddiqui are with the Big Data, Information and Knowledge Engineering Lab, Department of Computer Science and Engineering, University of Chittagong, Chattogram\-4331, Bangladesh \(e\-mail: rudra@cu\.ac\.bd\)\.††thanks:Umme Salma is with the Department of Computer Science and Engineering, Bangladesh University, Dhaka\-1207, Bangladesh\.††thanks:This work was partially supported by the Higher Education Acceleration and Transformation \(HEAT\) project, funded by the World Bank and the Government of Bangladesh, through the sub\-project no\. PIN\-13211 and the ICT Division, Bangladesh \(Fellowship code number: 1280101\-120008431\-3821117\)\.

###### Abstract

Cyberbullying is a growing concern in online communities, yet existing Bengali corpora remain limited in contextual information, annotation transparency, scale, accessibility, and support for multidimensional analysis, thereby hindering robust detection and comprehensive study of harasser behaviors and networks\. To address these gaps, we introduce the Bengali Contextual and Diverse Cyberbullying \(BenCoDiC\) corpus, a publicly available contextual cyberbullying resource for Bengali political news discourse comprising 50,250 textual instances collected from 100 YouTube videos and their associated discussions\. The corpus preserves caption–comment–reply relationships and is organized through a nine\-dimensional star schema covering users, videos, textual content, context, time, engagement, political parties, target identities, and language categories\. Five AI chatbots were initially evaluated for annotation but did not meet the predefined reliability criterion\. Consequently, a two\-tier human annotation process with expert verification was adopted, achieving Fleiss’κ=0\.86\\kappa=0\.86and Krippendorff’sα=0\.86\\alpha=0\.86\. Statistical analyses characterize the corpus, while transformer\-based experiments show that incorporating conversational context yields modest but consistent improvements over isolated\-text classification\.BenCoDiCsupports context\-aware cyberbullying detection and perpetrator\-oriented behavioral and network analysis\. The corpus is available at[https://github\.com/bencodic/BenCoDiC\-Corpus](https://github.com/bencodic/BenCoDiC-Corpus)\.

###### Index Terms:

BenCoDiC, Bengali, cyberbullying, corpus, low\-resource language\.

## IIntroduction

The rapid spread of affordable Internet and smartphones has made social media \(e\.g\., Facebook, X, YouTube\) central to daily communication worldwide\. This growth has also intensified cyberbullying, harmful or harassing behavior enabled by online anonymity\[[1](https://arxiv.org/html/2610.13121#bib.bib1)\]\. Its consequences are severe, contributing to anxiety, depression, low self\-esteem, and suicidal ideation\[[2](https://arxiv.org/html/2610.13121#bib.bib2)\], alongside social isolation and academic decline\.

Cyberbullying is a global issue and a critical concern in Bangladesh, where theBangladesh Cybercrime Trend 2023report indicates that cyberbullying\-related offenses accounted for 52\.21% of reported online crimes in 2022\[[3](https://arxiv.org/html/2610.13121#bib.bib3)\]\. Although reporting tools exist, moderating the vast volume of harmful content remains labor\-intensive, making automated detection essential\[[4](https://arxiv.org/html/2610.13121#bib.bib4)\]\. Effective systems require benchmark corpora that combine user text with contextual information for deeper analysis of perpetrator behavior and conversational dynamics\.

Extensive research in English and other high\-resource languages has produced numerous cyberbullying datasets, mostly comment\-level, ranging from binary\[[5](https://arxiv.org/html/2610.13121#bib.bib5),[6](https://arxiv.org/html/2610.13121#bib.bib6)\]to large multiclass resources\[[7](https://arxiv.org/html/2610.13121#bib.bib7),[8](https://arxiv.org/html/2610.13121#bib.bib8)\], as well as parallel corpora in multiple languages \(English and Dutch\)\[[9](https://arxiv.org/html/2610.13121#bib.bib9)\]\. To overcome limitations of isolated comment\-based corpora, session\-level datasets incorporating richer context, including videos, images, user metadata, temporal cues, and social\-graph features, have also emerged\[[10](https://arxiv.org/html/2610.13121#bib.bib10),[11](https://arxiv.org/html/2610.13121#bib.bib11)\]\.

For Bengali, a low\-resource language, available cyberbullying\-related datasets remain limited\[[12](https://arxiv.org/html/2610.13121#bib.bib12)\]\. Existing resources primarily contain user\-generated comments and support either binary classification\[[13](https://arxiv.org/html/2610.13121#bib.bib13),[14](https://arxiv.org/html/2610.13121#bib.bib14),[15](https://arxiv.org/html/2610.13121#bib.bib15)\]or multiclass classification\[[16](https://arxiv.org/html/2610.13121#bib.bib16),[17](https://arxiv.org/html/2610.13121#bib.bib17),[18](https://arxiv.org/html/2610.13121#bib.bib18)\]\. Although some studies report structured annotation procedures and reliability measures\[[13](https://arxiv.org/html/2610.13121#bib.bib13),[14](https://arxiv.org/html/2610.13121#bib.bib14),[19](https://arxiv.org/html/2610.13121#bib.bib19)\], several provide limited information on annotation guidelines, annotator qualifications, quality\-control procedures, or inter\-annotator agreement\[[20](https://arxiv.org/html/2610.13121#bib.bib20),[16](https://arxiv.org/html/2610.13121#bib.bib16),[21](https://arxiv.org/html/2610.13121#bib.bib21),[17](https://arxiv.org/html/2610.13121#bib.bib17)\]\. Furthermore, some datasets are relatively small\[[22](https://arxiv.org/html/2610.13121#bib.bib22),[17](https://arxiv.org/html/2610.13121#bib.bib17),[23](https://arxiv.org/html/2610.13121#bib.bib23)\]or not publicly accessible\[[24](https://arxiv.org/html/2610.13121#bib.bib24),[22](https://arxiv.org/html/2610.13121#bib.bib22),[19](https://arxiv.org/html/2610.13121#bib.bib19),[17](https://arxiv.org/html/2610.13121#bib.bib17)\], limiting reproducibility, comparative evaluation, and broader downstream use\.

Based on these limitations, we identify three key research gaps \(RGs\) in existing Bengali cyberbullying corpora:

- RG1Limited Contextual Information:Existing corpora commonly contain isolated posts or comments without conversational links or associated metadata, limiting context\-aware detection and analyses of user behavior, engagement, and interaction networks\.
- RG2Insufficiently Documented Annotation:Many resources inadequately report annotation guidelines, annotator qualifications, quality control, inter\-annotator agreement, or evaluations of AI\-assisted annotation, raising concerns about label reliability\.
- RG3Limited Scale and Accessibility:Many corpora are relatively small or not publicly accessible, restricting reproducibility and downstream use\.

To address these gaps, we introduce the large\-scaleBengaliContextual andDiverseCyberbullying \(BenCoDiC\) corpus for Bengali political news discourse, with the following research contributions \(RCs\):

- RC1Context\-Rich Structured Corpus:BenCoDiC preserves caption–comment–reply relationships and organizes content and metadata through a nine\-dimensional star schema, supporting context\-aware detection and multidimensional analyses of users, time, engagement, political topics, target identities, and language categories\.
- RC2Reliable Annotation Framework:After evaluating five AI chatbots, we adopt a two\-tier human annotation process with expert verification, achieving strong agreement \(Fleiss’κ=0\.86\\kappa=0\.86, Krippendorff’sα=0\.86\\alpha=0\.86\)\.
- RC3Large Open Dataset:BenCoDiC provides 50,250 labeled samples \(≈\\approx60%Bully, 40%Not Bully\), offering a large publicly available Bengali cyberbullying corpus for political news discourse\.

The remainder of the paper is structured as follows\.Section[II](https://arxiv.org/html/2610.13121#S2)reviews related work on cyberbullying corpora and highlights key limitations\.Section[III](https://arxiv.org/html/2610.13121#S3)describes the corpus development process and presents detailed corpus analyses, whileSection[IV](https://arxiv.org/html/2610.13121#S4)evaluates the impact of incorporating background conversational context\.Section[V](https://arxiv.org/html/2610.13121#S5)presents potential applications of the corpus\. Finally,Section[VI](https://arxiv.org/html/2610.13121#S6)concludes the paper and outlines future research directions, followed by a discussion of the study limitations\.

## IIRelated Work

This section reviews cyberbullying corpora across languages\. High\-resource languages include both large comment\-level and context\-rich session\-level resources, whereas Bengali resources remain more limited in conversational structure, annotation documentation, and accessibility\.

### II\-ACyberbullying Corpora in High\-resource Languages

Significant research in English and other high\-resource languages has produced a variety of cyberbullying corpora, mostly at the comment level\. For binary classification, Mali et al\.\[[5](https://arxiv.org/html/2610.13121#bib.bib5)\]introduced a dataset of 30,500 samples, while Founta et al\.\[[7](https://arxiv.org/html/2610.13121#bib.bib7)\]released an 80,000\-sample corpus annotated acrossNormal,Spam,Abusive, andHatefulcategories\. Beyond English, Van Hee et al\.\[[9](https://arxiv.org/html/2610.13121#bib.bib9)\]constructed English and Dutch corpora \(113,698 and 78,387 posts\) with detailed guidelines and inter\-annotator reliability reporting\.

To address the limitations of isolated comments, several works focus on session\-level corpora that embed contextual metadata\. Rafiq et al\.\[[10](https://arxiv.org/html/2610.13121#bib.bib10)\]developed a media\-session corpus consisting of videos, comments, and user information to support context\-aware cyberbullying detection\. Similarly, Hosseinmardi et al\.\[[11](https://arxiv.org/html/2610.13121#bib.bib11)\]introduced an Instagram session\-based dataset combining images, comments, temporal patterns, and social\-graph features\. More recently, Yang et al\.\[[25](https://arxiv.org/html/2610.13121#bib.bib25)\]created a Chinese session\-based corpus with fine\-grained comment\-level labels to enable explainable cyberbullying analysis\.

In contrast, our study develops a structured Bengali cyberbullying corpus tailored to a low\-resource setting\. By incorporating background context \(caption–comment–reply linkages\), user metadata, and content attributes, the corpus supports multiple downstream tasks, including cyberbullying detection, perpetrator identification, and behavioral and network\-level analysis\.

### II\-BBengali Cyberbullying and Related Text Resources

To position BenCoDiC relative to prior Bengali resources, we consider both cyberbullying corpora and related social\-media text classification datasets addressing overlapping forms of harmful discourse, including abusive language, hate speech, aggression, and harassment\[[26](https://arxiv.org/html/2610.13121#bib.bib26),[9](https://arxiv.org/html/2610.13121#bib.bib9)\]\. Although these tasks are related, they are not equivalent and differ in their annotation objectives and label definitions\. Accordingly, Table[I](https://arxiv.org/html/2610.13121#S2.T1)compares their resource characteristics rather than treating their dataset sizes as directly comparable\. The table summarizes the resources byReference,Task,Source,Ln\(language code\),Cls\(classification type\),CHP\(conversational hierarchy preserved\),CnM\(contextual metadata\),CAE\(AI chatbot annotation evaluation\),AG\(annotation guidelines\),AP\(annotation process\),ARM\(annotation reliability measurement\),Size\(sample count\), andPA\(public availability\)\. In accordance with the research gaps identified in Section[I](https://arxiv.org/html/2610.13121#S1), the comparison features are grouped intoRG1\(CHP,CnM\),RG2\(CA,AG,AP,ARM\), andRG3\(Size,PA\)\. A checkmark indicates that the corresponding feature is explicitly reported in the cited study rather than indicating its quality or strength\.

TABLE I:Comparison of Bengali corpora for cyberbullying and related social\-media text classification tasks\.ReferenceTaskSourceLnClsRG1RG2RG3CHPCnMCAEAGAPARMSizePARomim et al\.\[[13](https://arxiv.org/html/2610.13121#bib.bib13)\]Hate speechFacebook, YouTubeBnBC✗✗✗✓✓✓30000✓Islam et al\.\[[20](https://arxiv.org/html/2610.13121#bib.bib20)\]AbusiveFacebook, YouTubeBnBC✗✗✗✗✗✗12028✗Jahan et al\.\[[22](https://arxiv.org/html/2610.13121#bib.bib22)\]AbusiveFacebookBn, BnEn, RBnBC✗✗✗✗✓✗2000✗Chakraborty and Seddiqui\[[23](https://arxiv.org/html/2610.13121#bib.bib23)\]Threat, abusiveFacebookBnBC✗✗✗✗✗✗5644✗Bhattacharya et al\.\[[27](https://arxiv.org/html/2610.13121#bib.bib27)\]Aggression, MisogynyYouTubeBn, Hn, EnBC, MC✗✗✗✓✓✓\>\>25,000✓Lora et al\.\[[14](https://arxiv.org/html/2610.13121#bib.bib14)\]SarcasmFacebookBnBC✗✗✗✓✓✓25636✓Sihab\-Us\-Sakib et al\.\[[17](https://arxiv.org/html/2610.13121#bib.bib17)\]Cyber\-bullyingFacebook, YouTube, InstagramBnMC✗✗✗✗✗✗2751✗Mahmud et al\.\[[19](https://arxiv.org/html/2610.13121#bib.bib19)\]Cyber\-bullyingSocial mediaBn, CtgBC✗✗✗✓✓✓5100 \(Bn\), 5100 \(Ctg\)✗Ahmed et al\.\[[16](https://arxiv.org/html/2610.13121#bib.bib16)\]Cyber\-bullyingFacebookBnMC✗✗✗✗✗✗44001✓Uddin et al\.\[[21](https://arxiv.org/html/2610.13121#bib.bib21)\]Cyber\-bullyingFacebookBnBC, MC✗✗✗✗✗✗44,001\[[16](https://arxiv.org/html/2610.13121#bib.bib16)\]\+ 49,999✓Ahmed et al\.\[[24](https://arxiv.org/html/2610.13121#bib.bib24)\]Cyber\-bullyingYouTubeBn, RBnBC✗✗✗✗✗✗5000 \(Bn\), 7000 \(RBn\), 12000\(Bn, RBn\)✗BenCoDiC\(Proposed\)Cyber\-bullyingYouTubeBn, RBn, BnEn, En, EmoBC✓✓✓✓✓✓50250✓Bn= Bengali;RBn= Romanized Bengali;BnEn= Bengali–English code\-mix;En= English;Hn= Hindi;Ctg= Chittagonian;Emo= Emoji\-only;BC= Binary Class;MC= Multi\-Class\.Most existing resources support binary classification\. Islam et al\.\[[20](https://arxiv.org/html/2610.13121#bib.bib20)\]compiled 12,028 abusive samples but reported no annotation details \(RG2\) and did not publicly release the dataset \(RG3\)\. Romim et al\.\[[13](https://arxiv.org/html/2610.13121#bib.bib13)\]published a 30,000\-sample hate\-speech corpus, while Lora et al\.\[[14](https://arxiv.org/html/2610.13121#bib.bib14)\]introduced a 25,636\-sample sarcasm dataset; both provide documented annotation procedures and public access\. In contrast, Chakraborty and Seddiqui\[[23](https://arxiv.org/html/2610.13121#bib.bib23)\]developed a smaller corpus of 5,644 Facebook posts and comments with limited annotation documentation\. Despite their contributions to Bengali cyberbullying\-related research, none of these resources explicitly preserves conversational hierarchy or provides associated contextual metadata \(RG1\)\.

Several corpora support multiclass classification\. Ahmed et al\.\[[16](https://arxiv.org/html/2610.13121#bib.bib16)\]introduced a 44,001\-sample five\-class dataset for Bengali online harassment detection, which Uddin et al\.\[[21](https://arxiv.org/html/2610.13121#bib.bib21)\]later combined with another publicly available 49,999\-sample Bengali dataset to construct a 94,000\-sample fused resource\. Sihab\-Us\-Sakib et al\.\[[17](https://arxiv.org/html/2610.13121#bib.bib17)\]developed a smaller five\-category corpus containing 2,751 samples\. These resources do not preserve conversational hierarchy or provide associated contextual metadata \(RG1\) and provide limited documentation of their annotation procedures \(RG2\)\. Moreover, the corpus of\[[17](https://arxiv.org/html/2610.13121#bib.bib17)\]is relatively small and not publicly accessible \(RG3\)\.

Bengali has also been included in multilingual corpora\. Mahmud et al\.\[[19](https://arxiv.org/html/2610.13121#bib.bib19)\]developed a bilingual Bengali–Chittagonian dataset containing 5,100 samples in each language, whereas Bhattacharya et al\.\[[27](https://arxiv.org/html/2610.13121#bib.bib27)\]introduced a multilingual aggression and misogyny corpus spanning Bengali, Hindi, and English\. Neither resource preserves conversational hierarchy or provides associated contextual metadata \(RG1\)\. Bhattacharya et al\.\[[27](https://arxiv.org/html/2610.13121#bib.bib27)\]provide annotation guidelines, describe the annotation process, and report an annotation reliability measurement\. In contrast, the dataset of Mahmud et al\.\[[19](https://arxiv.org/html/2610.13121#bib.bib19)\]is not publicly accessible \(RG3\)\.

Other corpora incorporate multiple Bengali language forms\. Ahmed et al\.\[[24](https://arxiv.org/html/2610.13121#bib.bib24)\]developed Bengali, Romanized Bengali, and combined datasets containing 5,000, 7,000, and 12,000 samples, respectively\. However, the resource does not preserve conversational hierarchy or provide associated contextual metadata \(RG1\), provides insufficient information about annotator qualifications and annotation guidelines \(RG2\), and is not publicly available \(RG3\)\. Similarly, Jahan et al\.\[[22](https://arxiv.org/html/2610.13121#bib.bib22)\]compiled a 2,000\-sample abusive\-language corpus covering Bengali, Romanized Bengali, and Bengali–English code\-mixed text\. Although its annotation process was described, the guidelines were insufficiently detailed \(RG2\)\. The corpus also does not preserve conversational hierarchy or provide associated contextual metadata \(RG1\) and is not publicly available \(RG3\)\.

In summary, existing Bengali cyberbullying\-related corpora generally do not preserve conversational hierarchy and provide limited associated contextual metadata \(RG1\)\. Many also provide insufficient documentation of annotation practices, while annotation reliability measurements are not consistently reported across studies \(RG2\)\. None reports an evaluation of AI chatbot\-assisted annotation\. In addition, several resources are relatively small or not publicly accessible \(RG3\)\. The proposedBenCoDiCcorpus addresses these limitations by preserving caption–comment–reply relationships, providing structured contextual metadata, documenting and evaluating the annotation process, and releasing a large publicly available dataset \(see Table[I](https://arxiv.org/html/2610.13121#S2.T1)\)\.

## IIIBenCoDiC Corpus

This section describes the development of theBenCoDiCcorpus and presents a statistical analysis of its characteristics\. As illustrated in Figure[1](https://arxiv.org/html/2610.13121#S3.F1), the development process comprises source selection, keyword\-based video retrieval, data modeling, data extraction, cleaning, anonymization, annotation, and annotation evaluation\. The annotated samples are labeled as eitherbullyornot bully, and the final corpus is constructed after confirming annotation reliability\. The remainder of this section describes each development stage and summarizes the key statistical characteristics of the resulting corpus\.

![Refer to caption](https://arxiv.org/html/2610.13121v1/corpus-development-process.png)Fig\. 1:Development process of theBenCoDiCcorpus\.### III\-ASource Selection

YouTube is widely recognized as a major source of offensive and abusive online content\[[20](https://arxiv.org/html/2610.13121#bib.bib20)\]\. During the political unrest in Bangladesh in July–August 2024, bullying content became particularly visible on news\-oriented channels, where users interacted through captions, comments, and replies accompanied by contextual and engagement information\. We selected the political news domain not merely because of data availability, but because this period generated intensive public discussion involving political leaders, parties, and organizations, providing a socially important setting for examining potentially harmful discourse within preserved conversational relationships\. Accordingly, we selected eight widely viewed Bengali news channels: Jamuna TV, SOMOY TV, Channel 24, Ekattor TV, Independent Television, Rtv News, ATN Bangla News, and DBC NEWS\. The channels were selected based on subscriber count, number of uploaded videos, total view count, and channel age measured from their YouTube joining dates\.

### III\-BKeyword Search

Because this study focuses on political news in Bangladesh, the selected videos were organized into six categories\. Four categories represent major political parties with substantial parliamentary presence since 1991, namely AL, BNP, JaPa, and Jamaat\. The National Citizen Party \(NCP\), formed following the July–August 2024 uprising, constitutes another category\. The “Other” category comprises parties with parliamentary representation or notable political influence\. Relevant videos were identified through a manual keyword search within the eight selected Bengali YouTube news channels using each political party’s full name, acronym, and the names of prominent leaders\. The search was restricted to videos published between July 24 and November 10, 2024\. From the retrieved candidate videos satisfying these criteria, 100 videos were randomly selected while maintaining approximately balanced coverage across both news channels and political categories\. The final selection included 12 or 13 videos from each news channel, 16 videos for each of the five political\-party categories, and 20 videos in theOthercategory\.

### III\-CData Modeling

TheBenCoDiCcorpus is organized using a star schema, as illustrated in Figure[2](https://arxiv.org/html/2610.13121#S3.F2), to support multidimensional analysis of cyberbullying content and interactions\. At the center of the schema, theCyberbullyingAnalysisfact table connects nine dimensions:User,Video,TextualContent,Context,Time,ImpactScore,PoliticalParty,TargetIdentity, andLanguage\. The fact table also contains thebullyLabel, which assigns each textual instance a binary label of eitherbullyornot bully\. The annotation process is described in Section[III\-G](https://arxiv.org/html/2610.13121#S3.SS7)\.

Fig\. 2:The star schema of theBenCoDiCcorpus\.The attributes of the fact table and its dimensions are summarized in Table[II](https://arxiv.org/html/2610.13121#S3.T2)\. TheUserdimension stores channel\-level metadata, including the channel identifier, handler, title, subscriber count, video count, total view count, and joining date\. TheuserIdattribute uniquely represents the YouTube channel associated with the author of a textual instance\. For comments and replies, it identifies the corresponding commenter or reply author\. During anonymization, a persistent anonymized identifier was assigned so that the same author retains the same anonymizeduserIdacross different interactions\. This consistency supports user\-level aggregation and network analysis without exposing the original identity\. TheVideodimension contains video\-level metadata, such as duration, view count, like count, and comment count\. TheTextualContentdimension stores captions, comments, and replies, together with their identifiers, serial numbers, content types, and textual content\.

TABLE II:Attributes and descriptions of theBenCoDiCstar schema\.Fact andAttribute/DescriptionDimensionColumnuserIdPersistent anonymized identifier of the author’s YouTube channelhandlerAnonymized handler of the author’s YouTube channeltitleAnonymized title of the author’s YouTube channelUsersubscriberCountTotal number of channel subscribersvideoCountTotal number of videos uploaded by the channeluserViewCountTotal number of views received by the channel’s videosjoinedDateDate on which the channel joined YouTubevideoIdUnique identifier of a YouTube videodurationDuration of the videoVideoviewCountTotal number of views received by the videocommentCountTotal number of comments posted on the videolikeCountTotal number of likes received by the videocontentIdUnique identifier of a caption, comment, or replyTextualContentslnoSerial number of a caption, comment, or replycontentTypeType of textual content:caption,comment, orreplytextText of a caption, comment, or reply associated with a YouTube videocontextIdUnique identifier of a contextual relationshipContextparentSlnoSerial number of the parent caption or commentgrandparentSlnoSerial number of the associated caption serving as the grandparent contentTimetimeIdUnique identifier of a publication date and timepublishedTimePublication date and time of a video, comment, or replyimpactScoreIdUnique identifier of an engagement recordImpactScorelikeCountNumber of likes received by a comment or replyreplyCountNumber of replies received by a commentpartyIdUnique identifier of the political party associated with a videoPoliticalPartypartyNameFull name of the political partypartyShortNameAbbreviated name of the political partylanguageIdUnique identifier of a language categoryLanguagelanguageNameLanguage category of the textual content:Bengali,Romanized Bengali,code\-mixed Bengali–English,English, oremoji\-onlytargetIdUnique identifier of a target identity categoryTargetIdentitytargetNameTarget\-identity category:male,female,individual,people group,organization, orgeneral peopleCyberbullyingbullyLabelBinary label assigned to the text:bullyornot bullyAnalysisTheContextdimension preserves the hierarchical relationships among textual instances\. Comments are linked to their corresponding captions, whereas replies are linked to both their parent comments and associated captions through theparentSlnoandgrandparentSlnoattributes\. Because a caption may receive multiple comments and each comment may receive multiple replies, these relationships enable the reconstruction of threaded interactions\.

TheTimedimension records the publication date and time of videos, comments, and replies\. TheImpactScoredimension captures engagement information, including like counts for comments and replies and reply counts for comments\. ThePoliticalPartydimension identifies the political party associated with each video\. TheLanguagedimension records five language categories:Bengali,Romanized Bengali,code\-mixed Bengali–English,English, andemoji\-only\. Finally, theTargetIdentitydimension classifies the target of each textual instance into six categories:male,female,individual,people group,organization, andgeneral people\.

By integrating textual content, conversational relationships, channel and video metadata, temporal information, engagement measures, political topics, language categories, and target identities, the schema supports conventional cyberbullying detection as well as ontology\- and graph\-based analyses, including perpetrator identification, behavioral modeling, network analysis, and link prediction\.

### III\-DData Extraction

Using the keywords described in the preceding subsection, we identified the relevant source videos and retrieved their captions, comments, replies, and associated metadata through the YouTube Data API\. Data extraction was implemented using Google Apps Script and divided into two stages to accommodate its execution\-time limitation\. In the first stage, the textual content and associated video\- and interaction\-level metadata were extracted for each selected video\. In the second stage, channel\-level information was retrieved using the channel handler obtained during the first stage\. The resulting files were subsequently integrated in Python using thehandlerfield\. This process yielded 50,352 textual instances from 100 videos before data cleaning\.

Each caption, comment, and reply was stored as a separate record\. Their conversational hierarchy was preserved through theparentSlnoandgrandparentSlnoattributes of theContextdimension\. Channel\-level metadata were mapped to theUserdimension, while video\-level attributes were stored in theVideodimension\. The extracted textual content, publication times, and engagement measures were mapped to theTextualContent,Time, andImpactScoredimensions, respectively\.

Political\-party labels were assigned at the video level according to the political party represented directly in the video or through its associated leader or leaders\. The assigned party label was then inherited by the corresponding caption, comments, and replies\. Target identities were determined using a context\-aware, rule\-based labeling procedure based on the textual content, available conversational context, and associated metadata\. Language categories were assigned using a semi\-automated labeling procedure in which initial labels were generated through rule\-based identification incorporating thelangdetectPython module, followed by manual verification and correction where necessary\. These auxiliary dimensions were treated as metadata attributes rather than primary annotation targets and were not subjected to the two\-tier inter\-annotator agreement procedure used for the binary cyberbullying labels\. Consequently, separate reliability coefficients were not computed for these attributes\. The resulting records were linked through theCyberbullyingAnalysisfact table for subsequent cleaning, annotation, and analysis\.

For reproducibility, the accompanying GitHub repository provides the source\-video list, corpus schema, extraction procedure, annotation guidelines, data\-extraction and cleaning scripts, and a usage example\.

### III\-EData Cleaning

In the extracted dataset, thetextcolumn contains the textual content of captions, comments, and replies\. During preprocessing, noisy and irrelevant elements, including HTML tags, hyperlinks, and redundant whitespace, were removed\. Samples containing only numeric characters or unsupported non\-Bengali or non\-Latin scripts were excluded, while emoji\-only samples were retained\. However, single\-word samples were retained because, under context\-aware annotation, terms such as![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/vua.png)\(fake\),![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/chor.png)\(thief\),![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/abal.png)\(idiot\),![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/joker.png)\(joker\), and![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/batper.png)\(fraud\) can convey explicit bullying\. This cleaning process removed 102 noisy samples, reducing the dataset from 50,352 to 50,250 textual instances\.

### III\-FData Anonymization

To protect user privacy, channel\-related identifying information, including user IDs, handlers, and channel titles, was anonymized\. The anonymization mapping was kept consistent across the corpus so that the same user retains the same anonymizeduserId,handler, andtitleacross different comments and replies\.

### III\-GData Annotation

This subsection outlines the data annotation process for theBenCoDiCcorpus, combining initial experiments with AI chatbots and subsequent human annotation\. However, AI chatbots’ unreliable performance and inherent limitations led us to adopt human annotation as the primary strategy\. Qualified annotators, guided by well\-defined instructions and quality checks, ensured reliable labeling, finalized through majority voting to construct the gold\-standard corpus\.

#### III\-G1Annotation with AI Chatbots

As a preliminary experiment, we annotated 500 samples using five widely used AI chatbots: ChatGPT, Grok 3, DeepSeek, Gemini, and Perplexity, to evaluate their effectiveness in labeling Bengali texts as either bullying or non\-bullying\. To ensure fairness, all chatbots in the free\-tier version were provided with the same prompt, which required them to assign a binary label while considering the contextual hierarchy of captions, comments, and replies\. To examine the stability of their performance, we conducted experiments with four scenarios for each chatbot, varying across different user accounts and days: \(Account A, Day X\), \(Account B, Day X\), \(Account A, Day Y\), and \(Account B, Day Y\)\. Each chatbot therefore produced four accuracy scores\. The same 500 samples were used in all four scenarios so that variations in accuracy reflected changes in chatbot responses rather than differences in test data\. The 90% threshold was adopted a priori as a conservative study\-specific criterion for determining whether chatbot\-generated labels were sufficiently reliable for large\-scale corpus annotation, rather than as a universal standard for AI annotation reliability\. For statistical evaluation, the 90% threshold was adopted a priori as a conservative study\-specific reliability criterion\. A chatbot was considered sufficiently reliable only if its annotation accuracy reached at least 90%\.

Table[III](https://arxiv.org/html/2610.13121#S3.T3)reports the accuracy values from the four experiments, along with mean accuracy and 95% confidence intervals \(CIs\)\. The results show that ChatGPT achieved an average accuracy of 72\.2%, Grok 3 reached 79\.75%, DeepSeek 76\.0%, Gemini 70\.65%, and Perplexity 68\.55%\. Although Grok 3 achieved the highest mean accuracy among the five chatbots, the upper bounds of the corresponding 95% confidence intervals remained below the predefined 90% threshold\. Therefore, none of the tested free\-tier chatbot configurations satisfied the reliability criterion adopted in this study\. These results should be interpreted only within the scope of the 500\-sample evaluation and the specific free\-tier versions tested\. Because the four evaluations used the same 500 samples, the reported confidence intervals summarize variation across repeated chatbot runs rather than across independent test samples\.

TABLE III:Accuracy and 95% run\-level CIs of free\-tier AI chatbots for Bengali cyberbullying annotation\.This experiment was intended as a preliminary assessment rather than a comprehensive evaluation of AI\-based annotation methods\. Its scope is limited by the use of 500 samples and free\-tier chatbot versions\. Paid API versions, subsequently updated models, and task\-specific fine\-tuned language models were not evaluated\. Consequently, the findings should not be generalized beyond the tested configurations\.

All models responded quickly, although Grok 3’s reasoning mode was occasionally slower\. Clear bias patterns were observed: Grok 3 tended to over\-predict bully labels, whereas the others leaned toward not bully\. Hierarchical labeling remained weak across all systems, particularly for replies\. In terms of features, DeepSeek provides a large context window \(~128K tokens\), Gemini extends up to ~1M tokens with regional limitations and free API access, while the remaining chatbots offer smaller or unspecified limits\.

Due to the unreliable annotation performance, usage restrictions, labeling bias, and other inherent limitations of the free\-tier versions of the five AI chatbots, this study adopts human annotation as the labeling strategy for the entire dataset\.

#### III\-G2Human Annotation

A two\-tier human annotation strategy was used to construct the gold\-standard corpus\. As illustrated in Figure[3](https://arxiv.org/html/2610.13121#S3.F3), the process began with annotator training based on the annotation guidelines\. In Level\-1, three annotators independently labeled each sample, and majority voting was used to generate the primary labels\. These labels were subsequently reviewed in Level\-2 by three domain experts\. Inter\-annotator agreement was then assessed among the Level\-2 experts, and the annotations were finalized through majority voting after the predefined reliability threshold of 0\.81 was achieved\. If the Level\-2 agreement score fell below this threshold, the experts received additional guideline\-based training before the annotation was reassessed\.

![Refer to caption](https://arxiv.org/html/2610.13121v1/annotation-process.png)Fig\. 3:Annotation process of theBenCoDiCcorpus\.Annotator Selection and Background:In Level\-1, 51 final\-year undergraduate students from the Department of Computer Science and Engineering participated as annotators\. Bengali is their first language, while English is their second language\. Their education up to the Higher Secondary Certificate, equivalent to Class 12, was conducted primarily in Bengali, while English is the medium of instruction at the undergraduate level\. Although they did not have formal academic backgrounds in linguistics or sociology, they were familiar with contemporary Bengali online communication through active use of social\-networking platforms such as YouTube and Facebook\. No separate pre\-annotation screening or qualification test was administered\. Instead, their native\-language competence, bilingual academic exposure, familiarity with social\-media discourse, and subsequent guideline\-based training provided the basis for their participation in the Level\-1 annotation process\. In Level\-2, three faculty members from the same department, each with more than five years of research experience in natural language processing and relevant international publications, served as domain experts and independently verified the primary labels\.

Operational Definition Used in BenCoDiC:Cyberbullying overlaps with offensive language, abusive language, toxicity, hate speech, and harassment, but these phenomena are not equivalent because they differ in scope, targets, and annotation objectives\[[26](https://arxiv.org/html/2610.13121#bib.bib26),[28](https://arxiv.org/html/2610.13121#bib.bib28),[9](https://arxiv.org/html/2610.13121#bib.bib9)\]\. Its operationalization also varies across the literature, particularly regarding intent, repetition, and power imbalance, which are difficult to establish reliably in online interactions\[[9](https://arxiv.org/html/2610.13121#bib.bib9),[29](https://arxiv.org/html/2610.13121#bib.bib29)\]\. Following a less restrictive content\-level formulation, BenCoDiC defines a cyberbullying instance as target\-directed online content that, within its available conversational context, directly or indirectly threatens, insults, demeans, disparages, or dehumanizes a person, group, or organization, or explicitly endorses such content\. Target\-directed profanity, slurs, and derogatory emojis are included when they function as such attacks\. An identifiable target is therefore required, whereas repetition and power imbalance are not annotation requirements, and annotators do not infer intent beyond the observable textual and contextual evidence\. The labels represent cyberbullying content at the contextualized textual\-instance level rather than verified longitudinal bullying episodes\.

Annotation Guidelines and Training:A detailed context\-aware annotation guideline was developed in consultation with a sociolinguistics expert to support consistent labeling across captions, comments, and replies\. The expert conducted three one\-hour training sessions to familiarize the annotators with the guideline, contextual interpretation, and the decision criteria for distinguishing betweenbullyandnot bullycontent\. The seven categories were applied as annotation criteria rather than as mutually exclusive class labels\. For each textual instance, annotators examined the target text together with its available conversational context and determined whether one or more of the criteria were satisfied\. An instance was labeled asbullywhen at least one criterion was satisfied\. Otherwise, it was labeled asnot bully\. A single instance could satisfy multiple criteria, and no precedence was imposed among them\. Since only the final binary label was retained, inter\-category confusion was not assessed as a multiclass annotation outcome\. The seven annotation criteria are described below\.

- Cat1\.Profanity or Slurs:Texts containing target\-directed vulgar expressions, profane words, swearing, or slurs are labeled as bullying\. For example: ![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/khangkirput.png) \(What does the son of a prostitute say?\) The word “![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/khangki.png)” \(prostitute\) functions as a profane and derogatory expression\.
- Cat2\.Direct Personal Attack:Texts that explicitly threaten, insult, demean, or disparage an individual are labeled as bullying\. For example: ![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/tuito.png) \(You are a traitor\) This comment directly insults the targeted individual\.
- Cat3\.Indirect Personal Attack:Texts that implicitly mock, provoke, irritate, or disparage an individual without using explicitly aggressive language are also labeled as bullying\. For example: ![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/eto.png) \(So much hunger\) In isolation, the comment may appear harmless\. However, when interpreted with the caption “![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/janaprotinidhir.png)” \(There is no alternative to transferring power to the people’s representatives: Faruk\), it functions as an indirect personal attack\.
- Cat4\.Direct Group or Organizational Attack:Texts that explicitly insult, demean, dehumanize, or threaten a group or organization are labeled as bullying\. For example: ![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/era.png) \(They have become cruel\) This comment explicitly dehumanizes the targeted group\.
- Cat5\.Indirect Group or Organizational Attack:Texts that implicitly mock, provoke, irritate, or disparage a group or organization without explicit abusive language are also labeled as bullying\. For example: ![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/jatiya.png) \(New version of the National Party\) When interpreted with the caption ![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/rashtrapoti.png)\(Gonadhikar clarified its position on the president issue\), the comment implicitly disparages the political organization mentioned in the caption\.
- Cat6\.Support for Bullying Statements:A comment or reply that explicitly endorses a bullying statement is also labeled as bullying\. For example: Comment:![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/eder.png)\(They have no shame at all\) Reply:![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/sohomot.png)\(Agree\) Although the reply does not independently contain bullying language, it endorses the preceding bullying comment and is therefore labeled asbully\.
- Cat7\.Insult through Negative Emojis:Texts containing derogatory emojis, such as shoe or dog emojis, are labeled as bullying when the surrounding context indicates that they target a person, group, or organization\.

Several edge cases required careful interpretation\. Neutral expressions, agreement replies, emojis, and sarcasm were interpreted using the available conversational context, as illustrated in Cat3, Cat5, Cat6, and Cat7\. Romanized Bengali and Bengali–English code\-mixed texts posed different linguistic challenges because of non\-standard Romanized spelling and language mixing\. These variations were considered during interpretation before applying the same seven annotation criteria\.

Sample Distribution to Annotators:The 51 Level\-1 annotators were organized into 17 groups of three\. Each group was assigned approximately 3,000 of the 50,250 samples, and all three members independently annotated the same subset\. For each samplexix\_\{i\}, the majority\-voted label at either annotation level was computed as

y^i=𝕀⁡\(∑j=13yi​j≥2\),\\hat\{y\}\_\{i\}=\\mathbb\{I\}\\left\(\\sum\_\{j=1\}^\{3\}y\_\{ij\}\\geq 2\\right\),\(1\)
whereyi​j∈\{0,1\}y\_\{ij\}\\in\\\{0,1\\\}denotes the binary label assigned to samplexix\_\{i\}by annotatorjj, withj∈\{1,2,3\}j\\in\\\{1,2,3\\\}indexing the three annotators,11representingbully, and00representingnot bully\. The indicator function𝕀⁡\(⋅\)\\mathbb\{I\}\(\\cdot\)returns11when at least two of the three annotators assign thebullylabel and returns00otherwise\.

At Level\-1, Equation \([1](https://arxiv.org/html/2610.13121#S3.E1)\) was applied to generate the primary labels\. The Level\-1 majority\-voted primary label, together with the corresponding textual and contextual information, was then provided to each of the three Level\-2 experts\. Thus, the Level\-2 experts were not blinded to the Level\-1 primary labels\. Each expert independently reviewed the samples and assigned a verification label without consulting the other experts\. After confirming the required inter\-annotator agreement, the same majority\-voting rule was applied to the Level\-2 labels to determine the final corpus labels\.

### III\-HAnnotation Assessment

Inter\-annotator agreement and decision consistency were assessed at both annotation levels\. Table[IV](https://arxiv.org/html/2610.13121#S3.T4)summarizes the agreement scores and the frequencies of unanimous and majority decisions\. At Level\-1, Fleiss’κ\\kappaand Krippendorff’sα\\alphawere both 0\.81 across the complete set of 50,250 samples, while the group\-wise agreement scores across the 17 annotator groups ranged from approximately 0\.74 to 0\.85\. Of the Level\-1 decisions, 43,286 \(86\.14%\) were unanimous, where all three annotators assigned the same label, while 6,964 \(13\.86%\) required a 2–1 majority decision\.

TABLE IV:Inter\-annotator agreement and decision statistics at Level\-1 and Level\-2\.At Level\-2, Fleiss’κ\\kappaand Krippendorff’sα\\alphaboth increased to 0\.86\. The proportion of unanimous decisions increased from 86\.14% to 89\.87%, while the proportion of 2–1 majority decisions decreased from 13\.86% to 10\.13%\. Because a 2–1 decision represents disagreement among the three annotators in this binary annotation setting, the raw disagreement rate decreased by 3\.73 percentage points from Level\-1 to Level\-2, corresponding to a relative reduction of 26\.88%\.

Comparison of the Level\-1 majority\-voted primary labels with the final Level\-2 majority\-voted labels showed that 3,280 samples \(6\.53%\) changed labels during expert verification\. Among all samples, 1,282 \(2\.55%\) changed fromnot bullytobully, while 1,998 \(3\.98%\) changed frombullytonot bully\. These results indicate increased annotation consistency following Level\-2 expert verification\.

Although disagreement was not separately quantified by content type, language category, or other sample characteristics during annotation, several recurring sources of ambiguity were observed during annotator training and Level\-2 verification\. These included implicit or context\-dependent bullying expressions that appeared non\-bullying when read in isolation, benign or politically charged expressions that were sometimes interpreted as bullying, and replies whose interpretation depended strongly on the preceding comment or caption\. In such cases, an incorrect interpretation of the surrounding context could also affect the annotation of the associated reply\. Romanized Bengali, code\-mixed expressions, and emoji\-based content also occasionally required additional contextual interpretation\. Representative examples of such context\-dependent and emoji\-based cases are provided in the annotation guidelines above\. These observations are qualitative and are therefore not reported as subgroup disagreement rates\.

### III\-IFinal Corpus

Following the attainment of high inter\-annotator agreement, majority voting was applied to the Level\-2 annotations to construct the finalBenCoDiCcorpus, comprising 50,250 samples with twenty\-four columns, which are explained in Table[II](https://arxiv.org/html/2610.13121#S3.T2)\. Table[V](https://arxiv.org/html/2610.13121#S3.T5)presents sample examples of the cyberbullying classes\. The corpus is publicly available at[https://github\.com/bencodic/BenCoDiC\-Corpus](https://github.com/bencodic/BenCoDiC-Corpus)\.

TABLE V:Examples of the cyberbullying classes in BenCoDiC\.
### III\-JEthical Considerations

The development and release of theBenCoDiCcorpus involved several ethical considerations because the data contain offensive language, political opinions, and potentially sensitive user interactions\. Only publicly accessible YouTube content was collected through the YouTube API, and the data were collected and processed exclusively for research purposes\. To reduce privacy risks, channel\-related identifying information, including user IDs, handlers, and channel titles, was anonymized\. No attempt was made to identify or contact users or to infer additional personal information about them\.

The corpus preserves caption–comment–reply relationships because conversational context is necessary for context\-aware annotation and analysis\. These relationships are represented using anonymized internal identifiers, and only metadata relevant to the intended research tasks were retained\. The political\-party, language, and target\-identity attributes describe the contexts of textual instances and should not be interpreted as verified personal characteristics, political affiliations, or demographic profiles of individual users\.

Because the corpus contains abusive, profane, and potentially distressing content, annotators received annotation guidelines and training before labeling\. To support annotator well\-being, they were informed about the sensitive nature of the material and were permitted to pause or withdraw from the annotation process when necessary\. Annotation decisions were based on observable textual and conversational evidence rather than assumptions about users’ intentions or personal characteristics\.

The corpus is intended for research on cyberbullying detection and related behavioral and network analyses\. It should not be used for harassment, deanonymization, surveillance, political profiling, or punitive decisions about individuals\. Researchers are encouraged to preserve the anonymization measures, avoid attempts to reconstruct user identities, acknowledge potential biases, and interpret findings cautiously\. In particular, the corpus represents political discussions collected from selected Bengali news channels during a specific period and should not be considered representative of all Bengali speakers, political communities, or online interactions\.

### III\-KDataset Statistics

This subsection presents key statistics of theBenCoDiCcorpus, including class\-wise word and sample distributions, content\-type proportions, and variations across news channels and political\-party categories\. It also characterizes the distribution of target identities and language categories\. Together, these statistics provide an overview of the corpus and highlight characteristics of cyberbullying within Bengali political news discourse\.

Text\-Length and Lexical Statistics:Table[VI](https://arxiv.org/html/2610.13121#S3.T6)summarizes the word\- and sample\-level characteristics of the corpus\. For each class,minWord,maxWord, andavgWorddenote the minimum, maximum, and average numbers of words per sample, respectively, whiletotalWordandtotalSampledenote the total numbers of words and samples\. On average,Bullysamples contain more words thanNot Bullysamples \(12\.52 versus 9\.41\)\. Overall, the corpus contains 50,250 samples comprising 566,435 words, with approximately 60% labeled asBullyand 40% asNot Bully\.

TABLE VI:Textual statistics of theBenCoDiCcorpus across cyberbullying classes\.To further characterize text length, Fig\.[4](https://arxiv.org/html/2610.13121#S3.F4)presents the empirical cumulative distributions of the number of words per sample\. The two classes exhibit largely overlapping distributions, althoughBullysamples tend to be longer\. The median text lengths are 8 words forBullyand 5 words forNot Bullysamples\.

Fig\. 4:Empirical cumulative distributions of text length across theBullyandNot Bullyclasses\. The horizontal axis is presented on a logarithmic scale to accommodate the long\-tailed word\-count distributions\.Table[VII](https://arxiv.org/html/2610.13121#S3.T7)presents additional text\-length and lexical characteristics of the two classes\. TheBullyandNot Bullyclasses contain 44,980 and 26,157 unique tokens, respectively\. Of the 57,428 unique tokens across both classes, 13,709 are shared, corresponding to a Jaccard vocabulary overlap of 23\.87%\. Chi\-square analysis further identifies class\-associated unigrams, bigrams, and emojis\. TheBullyclass shows stronger associations with insulting and politically directed expressions, whereas supportive and affirmative expressions are more strongly associated with theNot Bullyclass\. Negative emojis such as![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/angry-emoji.png),![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/extreme-anger-emoji.png),![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/emojiShoe.png),![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/emojiDog.png), and![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/emojiVomiting.png)are more strongly associated withBullysamples, while![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/emoji-love-black.png),![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/emoji-love.png),![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/emoji-thumb.png),![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/emoji-bd.png), and![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/emoji-paddy.png)show stronger associations withNot Bullysamples\.

TABLE VII:Additional text\-length and class\-associated lexical statistics\.MeasureBullyNot BullyMedian words per sample85Vocabulary size44,98026,157Shared vocabulary13,709Combined unique vocabulary57,428Jaccard vocabulary overlap23\.87%Top five associated unigrams![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/unigrams-bully.png)![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/unigrams-not-bully.png)Top five associated bigrams![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/bigrams-bully-1.png)![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/bigrams-bully-2.png)![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/bigrams-not-bully-1.png)![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/bigrams-not-bully-2.png)Top five associated emojis![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/emojis-bully.png)![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/emojis-not-bully.png)Content\-Type Statistics:Figure[5](https://arxiv.org/html/2610.13121#S3.F5)presents the distribution ofBullyandNot Bullysamples across captions, comments, and replies\. Comments constitute the largest portion of the corpus, with 26,806Bullyand 17,562Not Bullysamples, followed by replies with 3,274 and 2,508 samples, respectively\. Captions form only a small portion of the dataset, comprising 3Bullyand 97Not Bullysamples\. Overall, comments account for approximately 88\.3% of the corpus\. Since these comments are responses to political\-news captions that commonly concern political leaders and parties, the content distribution also reflects the politically focused nature of the collected discourse\.

Fig\. 5:Distribution ofBullyandNot Bullysamples across content types\.Engagement Statistics:To examine the relationship between cyberbullying and user engagement, we focused on comments, which constitute 44,368 of the 50,250 samples \(approximately 88\.3%\) and are the only textual content type for which bothlikeCountandreplyCountare available at the content level\. Captions were excluded because their like counts correspond to the associated videos, while replies provide content\-level like counts but no corresponding reply\-count measure\. Comments therefore provide the most consistent basis for jointly analyzing these two forms of engagement\.

Table[VIII](https://arxiv.org/html/2610.13121#S3.T8)summarizes the engagement characteristics of 26,806Bullyand 17,562Not Bullycomments\. Because the engagement counts are sparse and right\-skewed, the mean, median, and interquartile range \(IQR\) are reported, and Spearman’s rank correlation is used as a non\-parametric measure of association\.Not Bullycomments received more likes on average thanBullycomments \(3\.35 versus 1\.62\) and slightly more replies \(0\.18 versus 0\.10\), although the median for both engagement measures was zero in both classes\.

TABLE VIII:Engagement characteristics and their association with bullying labels for comments\.WithNot Bullyencoded as 0 andBullyas 1, Spearman’s correlation was−0\.1314\-0\.1314for like count and−0\.0628\-0\.0628for reply count, with both associations statistically significant \(p<0\.001p<0\.001\)\. The negative but small coefficients indicate that higher engagement is weakly associated withNot Bullycomments in this corpus\.

Temporal Statistics:To examine temporal variation in the corpus, each textual instance was analyzed according to its own publication timestamp rather than the publication date of its associated source video\. Although the selected source videos were published from July to November 2024, their associated comments and replies continued to be posted afterward\. The observed posting\-time range of the complete corpus extends from July 24, 2024 to March 19, 2025, spanning nine calendar months\. All 50,250 samples were included in this analysis\.

Table[IX](https://arxiv.org/html/2610.13121#S3.T9)summarizes the monthly distribution of labeled samples\. Most textual activity occurred from July to November 2024, with August containing the largest number of samples \(15,432\) and November exhibiting the highestBullyproportion \(72\.01%\)\. After November, the monthly sample count fell below 120, so the corresponding percentages should be interpreted cautiously\. As shown in Figure[6](https://arxiv.org/html/2610.13121#S3.F6), theBullyproportion varies over time without a consistent increasing or decreasing trend\. July and March represent partial months because the observed corpus begins on July 24, 2024 and ends on March 19, 2025\.

TABLE IX:Monthly distribution of labeled samples by posting month\.Fig\. 6:Monthly proportion ofBullysamples by posting month\.News\-Channel Statistics:Table[X](https://arxiv.org/html/2610.13121#S3.T10)summarizes the distribution of videos and labeled samples across eight Bengali YouTube news channels\. The corpus includes 12 or 13 videos from each channel, indicating relatively even video coverage\. However, the number of textual samples varies across channels\. Jamuna TV contributes the largest number of samples overall and the highest number ofBullyinstances, followed by Independent Television and Ekattor TV in terms of bullying content\. DBC NEWS contributes the fewest samples in both classes\. Overall, all eight channels contain substantial numbers of bothBullyandNot Bullysamples\.

TABLE X:Channel\-wise distribution of videos and labeled samples in theBenCoDiCcorpus\.Political\-Party Statistics:Table[XI](https://arxiv.org/html/2610.13121#S3.T11)presents the distribution of videos and labeled samples across the associated political\-party categories\. AL, BNP, JaPa, Jamaat, and NCP are each represented by 16 videos, while theOthercategory contains 20 videos, providing relatively balanced video coverage across categories\. BothBullyandNot Bullysamples occur in every category, although theBullyproportion varies considerably, ranging from 43\.94% for Jamaat to 77\.70% for JaPa\. This variation further characterizes the politically structured nature of the discourse represented inBenCoDiC\.

TABLE XI:Distribution of videos and labeled samples across political\-party categories\.Target\-Identity Statistics:Figure[7](https://arxiv.org/html/2610.13121#S3.F7)presents the distribution ofBullyandNot Bullysamples across six target\-identity categories\. Among theBullysamples, males constitute the largest target category \(11,900\), followed by organizations \(10,456\) and people groups \(4,778\), while female targets account for 2,347 instances\. Given that most textual instances are comments on political\-news videos, male and female targets frequently correspond to political leaders discussed in the associated captions\. Organizations and people groups together account for 50\.64% of allBullysamples, indicating that bullying is also frequently directed toward collective political or organizational targets\. In contrast, only 12\.50% of instances in thegeneral peoplecategory are labeled asBully\. These patterns further reflect the domain\-specific characteristics of political news discourse represented inBenCoDiC\.

Fig\. 7:Distribution ofBullyandNot Bullysamples across target identities\.Language Category Statistics:Figure[8](https://arxiv.org/html/2610.13121#S3.F8)presents the distribution ofBullyandNot Bullysamples across the five language categories\. Bengali accounts for the largest share of the corpus, with 24,462Bullyand 14,459Not Bullysamples, followed by Romanized Bengali with 4,144 and 1,739 samples, respectively\. Code\-mixed, English, and emoji\-only samples are considerably less frequent\. WhileBullysamples outnumberNot Bullysamples in Bengali, Romanized Bengali, and code\-mixed text, the opposite pattern is observed for English and emoji\-only content\. Overall, the figure reveals a substantial imbalance across the language categories\.

Fig\. 8:Distribution ofBullyandNot Bullysamples across language categories\.Target–Language Cross\-Tabulation:To examine the joint distribution of target identity and language category presented separately in Figures[7](https://arxiv.org/html/2610.13121#S3.F7)and[8](https://arxiv.org/html/2610.13121#S3.F8), we further analyzed these dimensions across the two cyberbullying classes\. Table[XII](https://arxiv.org/html/2610.13121#S3.T12)cross\-tabulates the six target\-identity categories with the five language categories and separately reports the numbers ofBullyandNot Bullysamples for each combination\.

TABLE XII:Cross\-tabulation of target identity and language category across theBullyandNot Bullyclasses\.The cross\-tabulation reveals several patterns that are not evident from the separate target\-identity and language\-category distributions\. Male and organizational targets account for the largest numbers ofBullysamples, particularly in Bengali and Romanized Bengali content\. People\-group targets also contain moreBullythanNot Bullysamples in Bengali, Romanized Bengali, and Code\-Mix content\. In contrast, general people contain moreNot Bullysamples across all five language categories\. English and Emoji\-Only content also contain moreNot BullythanBullysamples across all target\-identity categories\. These results show that the distribution of cyberbullying labels varies jointly across target identity and language category\.

Taken together, the political\-party, target\-identity, and target–language distributions characterize the domain\-specific nature ofBenCoDiC\. The variation in bullying prevalence across political\-party categories and the frequent targeting of political figures, organizations, and people groups reflect the political focus of the corpus\. The target–language cross\-tabulation further shows that these targeting patterns vary across language categories\. These characteristics should be considered when comparingBenCoDiCwith broader social\-media datasets\. Since all source videos belong to the political\-news domain, we do not introduce a separate binary “high\-political\-intensity” flag, which would require an additional operational definition and threshold\. Instead, the political\-party and target\-identity metadata included in the corpus enable users to construct task\-specific strata reflecting variations in political focus\.

## IVExperimental Evaluation

This section evaluates the effectiveness of BenCoDiC for context\-aware cyberbullying classification and examines the contribution of conversational context\. The experiments compare context\-free and flat\-context settings across six transformer\-based models using video\-disjoint data partitions and repeated evaluations with multiple split and run seeds\. Performance is assessed using macro\-averaged and weighted metrics, together with paired statistical analysis\. We further investigate a simple hierarchical\-context formulation, analyze the contribution of individual contextual elements through controlled ablation, and examine representative prediction errors to better understand when contextual information helps or hinders classification\.

### IV\-AExperimental Protocol

To obtain a leakage\-resistant evaluation of contextual information in BenCoDiC, we adopted a video\-disjoint partitioning strategy rather than an instance\-level random split\. All captions, comments, and replies associated with the same video were assigned exclusively to one partition\. This separation is particularly important for the contextual setting, where a comment incorporates its associated caption and a reply incorporates both its caption and parent comment\. Consequently, contextual information used in the validation or test set cannot originate from a video represented in the training set\.

The 100 videos were divided into training, validation, and test sets using a target ratio of 60:20:20 at the video level\. To account for variation arising from data partitioning, three splits were generated using seeds0,42,85\{0,42,85\}\. For each split, 60 videos were assigned to training, 20 to validation, and 20 to testing\. Candidate partitions were evaluated according to their agreement with the desired sample proportion, class distribution, and content\-type distribution\. Each selected split was then verified to ensure no video overlap across partitions and to preserve the caption, comment, and reply hierarchy within each partition\.

Table[XIII](https://arxiv.org/html/2610.13121#S4.T13)summarizes the resulting distributions\. Across all three splits, the sample proportions remain close to the intended 60:20:20 ratio, while the proportion of Bully instances ranges from 59\.14% to 61\.03%\. The content\-type distributions also remain comparable across the corresponding partitions\. The exact video assignments for the three benchmark splits are provided in the accompanying GitHub repository\.

TABLE XIII:Distribution of the video\-disjoint training, validation, and test partitions across three split seeds\.
### IV\-BContext Formulation

To evaluate the contribution of conversational context, each textual instance was represented under two settings: context\-free and flat context\. The prediction target and class label remain identical across both settings, while only the input representation changes\. Lettit\_\{i\}denote the target text of instanceii,c⁡\(i\)c\(i\)its associated video caption, andp⁡\(i\)p\(i\)the parent comment when the target is a reply\.

In the context\-free setting, each caption, comment, or reply is classified independently using only its own text\. The input is defined as

xiCF=ti\.x\_\{i\}^\{\\mathrm\{CF\}\}=t\_\{i\}\.\(2\)
In the flat\-context setting, contextual information from the caption, comment, and reply hierarchy is combined into a single input sequence\. A caption is represented by its own text because no preceding context is available\. For a comment, the associated video caption is combined with the target comment\. For a reply, the video caption and parent comment are combined with the target reply\. Thus,

xiFC=\{ti,if​ti​is a caption,c⁡\(i\)⊕ti,if​ti​is a comment,c⁡\(i\)⊕p⁡\(i\)⊕ti,if​ti​is a reply,x\_\{i\}^\{\\mathrm\{FC\}\}=\\begin\{cases\}t\_\{i\},&\\text\{if \}t\_\{i\}\\text\{ is a caption\},\\\\ c\(i\)\\oplus t\_\{i\},&\\text\{if \}t\_\{i\}\\text\{ is a comment\},\\\\ c\(i\)\\oplus p\(i\)\\oplus t\_\{i\},&\\text\{if \}t\_\{i\}\\text\{ is a reply\},\\end\{cases\}\(3\)where⊕\\oplusdenotes concatenation\.

The contextual elements are arranged in conversational order, with the target text placed at the end of the sequence\. This paired formulation isolates the effect of background context while keeping the prediction instances, labels, and data partitions unchanged\.

### IV\-CModels and Training Configuration

We evaluated six encoder\-based transformer models: BanglaBERT, Bangla\-Bert\-Base, BanglishBERT, IndicBERT v2, mBERT, and XLM\-R\-base\. These models were selected to provide diverse linguistic representations while retaining a common Transformer\-based architecture that uses self\-attention to capture contextual dependencies in text\[[30](https://arxiv.org/html/2610.13121#bib.bib30)\]\. BanglaBERT and Bangla\-Bert\-Base are Bengali\-specific models, BanglishBERT is pretrained on Bengali and English, while IndicBERT v2, mBERT, and XLM\-R\-base are multilingual models that include Bengali in their language coverage\[[31](https://arxiv.org/html/2610.13121#bib.bib31),[32](https://arxiv.org/html/2610.13121#bib.bib32),[33](https://arxiv.org/html/2610.13121#bib.bib33),[34](https://arxiv.org/html/2610.13121#bib.bib34)\]\. These models have also been employed in Bengali text\-classification tasks, including cyberbullying detection, where language\-specific and multilingual transformers have demonstrated competitive performance\[[17](https://arxiv.org/html/2610.13121#bib.bib17),[35](https://arxiv.org/html/2610.13121#bib.bib35)\]\. Their inclusion enables the effect of conversational context to be examined across different pretraining characteristics and linguistic coverage\.

The pretrained checkpoints werecsebuetnlp/banglabert\(BanglaBERT\),sagorsarker/bangla\-bert\-base\(Bangla\-Bert\-Base\),csebuetnlp/banglishbert\(BanglishBERT\),ai4bharat/IndicBERTv2\-MLM\-only\(IndicBERT v2\),google\-bert/bert\-base\-multilingual\-uncased\(mBERT\), andxlm\-roberta\-base\(XLM\-R\-base\)\. Each checkpoint was paired with its corresponding pretrained tokenizer\.

All six models were fine\-tuned under the same experimental configuration to maintain comparability across models and input settings\. The learning rate was set to2×10−52\\times 10^\{\-5\}with a weight decay of 0\.01, a batch size of 16, and three training epochs\. Model selection was based on macro\-F1 on the validation set, and the checkpoint with the highest validation macro\-F1 was retained for test\-set evaluation\.

Inputs were tokenized using the corresponding model\-specific tokenizer with truncation enabled and a maximum sequence length of 192 tokens\. The same tokenization settings were applied to the context\-free and flat\-context inputs\. The maximum length was selected based on the token\-length distribution obtained from each model\-specific tokenizer\. At this threshold, approximately 1\.86% of contextual inputs exceeded the limit for mBERT, while the corresponding proportion remained below 0\.31% for each of the other five models\.

To account for variability arising from both data partitioning and model fine\-tuning, experiments were conducted using three video\-disjoint split seeds\{0,42,85\}\\\{0,42,85\\\}\. For each split, every model\-setting combination was independently trained using three run seeds\{7,12,51\}\\\{7,12,51\\\}\. The context\-free and flat\-context settings used the same split and run seed combinations, yielding nine matched evaluations for each model\.

### IV\-DEvaluation Metrics and Statistical Protocol

Performance was evaluated using macro precision, macro recall, macro F1\-score, weighted F1\-score, and accuracy\. Given the moderately imbalanced class distribution of BenCoDiC, macro\-averaged metrics were emphasized because they assign equal importance to both classes\. Macro F1\-score was treated as the primary evaluation metric, while weighted F1\-score and accuracy were reported as complementary measures of overall classification performance\.

For each model and input setting, performance was summarized as the mean and standard deviation across the nine evaluations obtained from the combinations of data splits and training runs\. This reporting strategy captures performance variation associated with both data partitioning and model fine\-tuning\.

To assess the effect of conversational context, the context\-free and flat\-context results were compared using matched split and run combinations\. For each splitjjand runrr, the difference in macro F1\-score was calculated as

Δ​F​1j,r=F​1j,rFC−F​1j,rCF,\\Delta F1\_\{j,r\}=F1^\{\\mathrm\{FC\}\}\_\{j,r\}\-F1^\{\\mathrm\{CF\}\}\_\{j,r\},\(4\)
whereFC\\mathrm\{FC\}andCF\\mathrm\{CF\}denote the flat\-context and context\-free settings, respectively\. Positive values indicate improved performance after incorporating conversational context\. The mean of the paired differences was used to quantify the overall contextual gain\.

To evaluate the uncertainty associated with this gain, a 95% paired confidence interval \(CI\) was estimated from the matched differences\. The interval was calculated as

Δ​F​1¯±t0\.975,8​sΔ9,\\overline\{\\Delta F1\}\\pm t\_\{0\.975,8\}\\frac\{s\_\{\\Delta\}\}\{\\sqrt\{9\}\},\(5\)
whereΔ​F​1¯\\overline\{\\Delta F1\}denotes the mean paired difference,sΔs\_\{\\Delta\}denotes sample standard deviation of the paired differences, andt0\.975,8t\_\{0\.975,8\}is the critical value of thettdistribution with eight degrees of freedom\. If the entire 95% confidence interval lies above zero, it provides evidence that the flat\-context setting achieves a positive mean improvement over the context\-free setting\.

### IV\-EComparison of Context\-Free and Flat\-Context Results

Table[XIV](https://arxiv.org/html/2610.13121#S4.T14)presents the performance of the six transformer models under the context\-free and flat\-context settings\. The flat\-context setting improves the mean macro precision, macro recall, macro F1\-score, weighted F1\-score, and accuracy for every model\. Among the evaluated models, BanglaBERT achieves the highest overall performance\. Its macro F1\-score increases from0\.8277±0\.01150\.8277\\pm 0\.0115in the context\-free setting to0\.8353±0\.00850\.8353\\pm 0\.0085with flat context, while its accuracy increases from0\.8335±0\.01210\.8335\\pm 0\.0121to0\.8426±0\.00800\.8426\\pm 0\.0080\. IndicBERT v2 shows closely comparable performance, achieving a macro F1\-score of0\.8347±0\.01070\.8347\\pm 0\.0107and an accuracy of0\.8419±0\.00990\.8419\\pm 0\.0099with flat context\. The consistent direction of improvement across all six models indicates that preceding conversational information provides useful evidence beyond the target text alone\.

TABLE XIV:Performance comparison of the context\-free and flat\-context settings\. Results are reported as mean±\\pmstandard deviation across nine evaluations\.The magnitude and uncertainty of the contextual improvement are further examined in Table[XV](https://arxiv.org/html/2610.13121#S4.T15)\. The mean gain in macro F1\-score ranges from 0\.0048 to 0\.0084, corresponding to approximately 0\.48 to 0\.84 percentage points\. The largest mean improvement is obtained by mBERT, followed by BanglaBERT and IndicBERT v2\. Although these gains are modest in magnitude, the 95% paired confidence intervals lie entirely above zero for all six models\. Under the paired statistical protocol described in Section[IV\-D](https://arxiv.org/html/2610.13121#S4.SS4), these results are considered statistically significant and provide evidence of a positive mean effect of incorporating conversational context across the repeated evaluations\.

TABLE XV:Paired analysis of the contextual gain in macro F1\-score\.Overall, the results demonstrate that incorporating caption and parent\-comment information yields small but systematic improvements across models with different linguistic and pretraining characteristics\. These findings support the usefulness of the conversational structure provided by BenCoDiC and motivate a more detailed examination of the contribution of individual context elements in the following subsection\.

### IV\-FHierarchical Context and Context\-Element Ablation Analysis

To examine whether preserving the conversational components separately provides an effective alternative to flat concatenation, we implemented a simple hierarchical\-context baseline\. BanglaBERT was selected as the representative encoder because it achieved the highest overall macro F1\-score among the six models in the preceding context comparison\. In the hierarchical formulation, the available contextual components and the target texttit\_\{i\}, which may be a caption, comment, or reply, are represented separately\. The video caption, parent comment, and target text are encoded using a shared BanglaBERT encoderEE\. Let

hc=E⁡\(c⁡\(i\)\),hp=E⁡\(p⁡\(i\)\),ht=E⁡\(ti\),h\_\{c\}=E\(c\(i\)\),\\qquad h\_\{p\}=E\(p\(i\)\),\\qquad h\_\{t\}=E\(t\_\{i\}\),\(6\)
wherehch\_\{c\},hph\_\{p\}, andhth\_\{t\}denote the representations of the caption, parent comment, and target text, respectively\. For a caption target, onlyhth\_\{t\}is available\. For a comment target,hch\_\{c\}andhth\_\{t\}are available, while for a reply target, all three representations are available\. The representations are concatenated as

hi=hc⊕hp⊕ht,h\_\{i\}=h\_\{c\}\\oplus h\_\{p\}\\oplus h\_\{t\},\(7\)
where⊕\\oplusdenotes representation concatenation\. When a contextual component is unavailable, its corresponding representation is replaced by a zero vector of the same dimension\. The resulting3​d3d\-dimensional representation is passed through dropout and a linear classification layer to predict the class label\.

The hierarchical\-context setting achieved a macro F1\-score of0\.8320±0\.01140\.8320\\pm 0\.0114, a weighted F1\-score of0\.8385±0\.01080\.8385\\pm 0\.0108, and an accuracy of0\.8379±0\.01120\.8379\\pm 0\.0112\. These results lie between the context\-free and flat\-context performance of BanglaBERT reported in Table[XIV](https://arxiv.org/html/2610.13121#S4.T14)\. The context\-free setting achieved a macro F1\-score of0\.8277±0\.01150\.8277\\pm 0\.0115, whereas the flat\-context setting achieved0\.8353±0\.00850\.8353\\pm 0\.0085\. The same overall pattern is observed for weighted F1\-score and accuracy\. Thus, the hierarchical formulation improves over target\-only classification but does not surpass flat\-context integration\. This suggests that conversational context is beneficial, while direct sequence\-level integration of contextual information is more effective than the simple representation\-level fusion considered in the hierarchical baseline\.

To further identify the contribution of individual contextual elements, we conducted a controlled ablation analysis within the same hierarchical architecture\. The analysis focuses on replies because they are the only content type for which both contextual sources, the video caption and parent comment, are available\. Evaluating the ablation variants only on replies therefore enables the effects of the two contextual elements to be compared without the results being dominated by captions or comments\.

Four configurations were considered:

A​0\\displaystyle A0:𝟎⊕𝟎⊕ht,\\displaystyle:\\mathbf\{0\}\\oplus\\mathbf\{0\}\\oplus h\_\{t\},A​1\\displaystyle A1:hc⊕𝟎⊕ht,\\displaystyle:h\_\{c\}\\oplus\\mathbf\{0\}\\oplus h\_\{t\},A​2\\displaystyle A2:𝟎⊕hp⊕ht,\\displaystyle:\\mathbf\{0\}\\oplus h\_\{p\}\\oplus h\_\{t\},A​3\\displaystyle A3:hc⊕hp⊕ht,\\displaystyle:h\_\{c\}\\oplus h\_\{p\}\\oplus h\_\{t\},
where𝟎\\mathbf\{0\}denotes a zero vector corresponding to an unavailable contextual component\. A0 represents the target\-only control within the hierarchical architecture, A1 incorporates the caption, A2 incorporates the parent comment, and A3 incorporates both contextual elements\. A3 corresponds to the full hierarchical\-context setting described above\. All four configurations retain the same shared encoder,3​d3d\-dimensional fusion representation, classifier, training configuration, data splits, and run seeds\. Thus, only the availability of the contextual elements varies across the ablation settings\.

Table[XVI](https://arxiv.org/html/2610.13121#S4.T16)presents the reply\-level results averaged across the nine evaluations\. A0 obtains a macro F1\-score of0\.7789±0\.02600\.7789\\pm 0\.0260\. Incorporating the caption in A1 increases the mean macro F1\-score to0\.7817±0\.02040\.7817\\pm 0\.0204, while incorporating the parent comment in A2 yields a higher score of0\.7855±0\.02230\.7855\\pm 0\.0223\. The full hierarchical configuration, A3, achieves the highest reply\-level macro F1\-score of0\.7882±0\.01860\.7882\\pm 0\.0186\.

TABLE XVI:Reply\-level context\-element ablation results for BanglaBERT\. Results are reported as mean±\\pmstandard deviation across nine evaluations\.Relative to A0, adding caption context in A1 improves the mean reply macro F1\-score by approximately 0\.28 percentage points, whereas adding the parent comment in A2 yields a larger improvement of approximately 0\.66 percentage points\. Combining both contextual elements in A3 produces the largest mean gain of approximately 0\.93 percentage points over A0\. These results indicate that both contextual sources contribute useful information for reply classification, with the parent comment showing a greater individual contribution than the video caption\. The highest performance obtained by A3 further suggests that combining immediate conversational context with the broader caption context provides the most informative representation among the evaluated hierarchical variants\.

### IV\-GQualitative Error Analysis

To provide further insight into the experimental results, we examined the paired predictions of BanglaBERT under the context\-free and flat\-context settings\. A representative evaluation with split seed 0 and run seed 12 was selected, in which both settings were tested on the same instances\. The analysis focused on cases in which contextual information corrected or introduced prediction errors, as well as errors that remained under both settings\.

We first examined errors corrected by contextual information\. For example, the comment![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/vua.png)\(fake\) was incorrectly predicted as not bully without context but correctly classified as bully when its video caption was included\. Similarly, the reply “Right” was misclassified as not bully in isolation, while the parent comment provided the conversational context needed for the correct bully prediction\. Context also corrected a false positive for![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/eder-bichar.png)\(They should be brought to justice\), which was incorrectly predicted as bully without context but correctly classified as not bully when the associated caption was considered\. These examples show that contextual information can resolve ambiguity in context\-dependent expressions\.

We next examined cases in which contextual information introduced an error\. For example, the comment![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/mittha.png)\(false\) was correctly classified as not bully in the context\-free setting but misclassified as bully when the associated caption was included\. Conversely,![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/awami.png)\(Awami terrorists should be brought to justice\) was correctly classified as bully without context but misclassified as not bully in the flat\-context setting\. These cases show that contextual information can sometimes introduce misleading cues or weaken discriminative information in the target text\.

We also identified cases that remained false negatives under both settings, where instances labeled as bully were classified as not bully with and without context\. For example, “VONDO” \(hypocrite\) and![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/ekti.png)\(a goat\) were labeled as bully but predicted as not bully under both settings\. Similarly, “Jann0r” \(animal\) remained misclassified even after contextual information was included\. These cases suggest that implicit insults, Romanized Bengali expressions, and symbolic forms can remain challenging even when conversational context is available\.

Conversely, some instances labeled as not bully were classified as bully under both settings, resulting in false\-positive errors\. For example,![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/priyo.png)\(Dear Sheikh\),![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/jatiya-sera.png)\(Jatiya Party is the best\), and![[Uncaptioned image]](https://arxiv.org/html/2610.13121v1/figs/bengali-text/jhilapi.png)\(I will eat jalebi\) remained incorrectly classified as bully under both settings\. These cases indicate that benign or supportive expressions within politically charged discussions can still be difficult to distinguish from bullying content\.

## VPotential Application Tasks

TheBenCoDiCcorpus supports several potential research applications in cyberbullying analysis:

- •Cyberbullying Detection \(Task A\):Using theTextualContentandContextdimensions to develop models that classify textual instances asbullyornot bully\. The influence of background conversational context on this task is evaluated in Section[IV](https://arxiv.org/html/2610.13121#S4)\.
- •Perpetrator Identification \(Task B\):Leveraging persistent anonymized user identifiers and labeled interaction histories to identify users who repeatedly generate bullying content and to examine their activity patterns\.
- •Behavioral and Network Analysis \(Task C\):Integrating theUser,Video,Context,Time,ImpactScore,PoliticalParty,Language, andTargetIdentitydimensions to analyze perpetrator behavior, targeting patterns, engagement characteristics, and community\-level interactions\.
- •Link Prediction among Perpetrators \(Task D\):Constructing perpetrator networks in which nodes represent anonymized users and edges capture behavioral or contextual similarities derived from multiple dimensions\. Such networks can support the prediction of potential associations among perpetrators\.

Beyond these tasks, the multidimensional metadata in BenCoDiC also provides opportunities for metadata\-aware multitask and few\-shot learning\. Auxiliary information such as language category, target identity, political\-party information, temporal attributes, and engagement characteristics can be explored jointly with cyberbullying classification in future studies\.

## VIConclusion

This work presents the Bengali Contextual and Diverse Cyberbullying \(BenCoDiC\) corpus, a publicly available resource comprising 50,250 textual instances from Bengali political news discourse\. The corpus preserves caption–comment–reply relationships through a nine\-dimensional star schema integrating users, videos, textual content, context, time, engagement, political parties, target identities, and language categories\. A two\-tier human annotation process with expert verification achieved Fleiss’κ=0\.86\\kappa=0\.86and Krippendorff’sα=0\.86\\alpha=0\.86\. Experimental results further show that incorporating conversational context yields modest but consistent improvements over isolated\-text classification\.

BenCoDiCsupports context\-aware cyberbullying detection and multidimensional research on perpetrator behavior and interaction networks\. Future work will expand the corpus beyond political news, improve the representation of underrepresented language categories, align the resource with FAIR and Linked Data principles, and investigate ontology\- and graph\-based methods for perpetrator identification, behavioral and network analysis, and link prediction\.

## Limitations

This study focuses on political news collected from selected Bengali YouTube channels during a specific period and may therefore exhibit topical, temporal, and selection bias\. The corpus should primarily be interpreted as a resource for Bengali political\-news discourse rather than as a representative sample of general Bengali social\-media communication\. Comments constitute approximately 88\.3% of the corpus, while political\-category, target\-identity, and language distributions remain domain\-specific\. Bengali\-script text dominates the corpus, whereas Romanized Bengali, Bengali–English code\-mixed text, English, and emoji\-only content are underrepresented\. The class distribution is also moderately imbalanced, with approximately 60%Bullyand 40%Not Bullysamples\.

The auxiliary political\-party, target\-identity, and language attributes were treated as metadata and were not subjected to the two\-tier inter\-annotator reliability assessment used for the binary cyberbullying labels\. The preliminary AI\-chatbot evaluation was limited to 500 samples and free\-tier systems\. In addition, because the Level\-2 experts had access to the Level\-1 primary labels during verification, the expert review process may be susceptible to anchoring bias\. These limitations should be considered when interpreting and reusing the corpus\.

## References

- \[1\]M\. Kim, M\. Ellithorpe, and S\. Burt, “Anonymity and its role in digital aggression: A systematic review,”*Aggression and Violent Behavior*, vol\. 72, p\. 101856, Sep\. 2023\. \[Online\]\. Available:[http://dx\.doi\.org/10\.1016/j\.avb\.2023\.101856](http://dx.doi.org/10.1016/j.avb.2023.101856)
- \[2\]Y\. Peled, “Cyberbullying and its influence on academic, social, and emotional development of undergraduate students,”*Heliyon*, vol\. 5, no\. 3, p\. e01393, Mar\. 2019\. \[Online\]\. Available:[http://dx\.doi\.org/10\.1016/j\.heliyon\.2019\.e01393](http://dx.doi.org/10.1016/j.heliyon.2019.e01393)
- \[3\]T\. Rahman, M\. M\. Hossain, N\. N\. Bristy, M\. Z\. Hoque, and M\. M\. Hossain, “Influence of cyber\-victimization and other factors on depression and anxiety among university students in bangladesh,”*Journal of Health, Population and Nutrition*, vol\. 42, no\. 1, Nov\. 2023\. \[Online\]\. Available:[http://dx\.doi\.org/10\.1186/s41043\-023\-00469\-0](http://dx.doi.org/10.1186/s41043-023-00469-0)
- \[4\]G\. Jacobs, C\. Van Hee, and V\. Hoste, “Automatic classification of participant roles in cyberbullying: Can we detect victims, bullies, and bystanders in social media text?”*Natural Language Engineering*, vol\. 28, no\. 2, p\. 141–166, Nov\. 2020\. \[Online\]\. Available:[http://dx\.doi\.org/10\.1017/S135132492000056X](http://dx.doi.org/10.1017/S135132492000056X)
- \[5\]M\. K\. Mali, R\. R\. Pawar, S\. A\. Shinde, S\. D\. Kale, S\. V\. Mulik, A\. A\. Jagtap, P\. A\. Tambewagh, and P\. U\. Rajput, “Automatic detection of cyberbullying behaviour on social media using stacked bi\-gru attention with bert model,”*Expert Systems with Applications*, vol\. 262, p\. 125641, Mar\. 2025\. \[Online\]\. Available:[http://dx\.doi\.org/10\.1016/j\.eswa\.2024\.125641](http://dx.doi.org/10.1016/j.eswa.2024.125641)
- \[6\]N\. A\. Samee, U\. Khan, S\. Khan, M\. M\. Jamjoom, M\. Sharif, and D\. H\. Kim, “Safeguarding online spaces: A powerful fusion of federated learning, word embeddings, and emotional features for cyberbullying detection,”*IEEE Access*, vol\. 11, p\. 124524–124541, 2023\. \[Online\]\. Available:[http://dx\.doi\.org/10\.1109/ACCESS\.2023\.3329347](http://dx.doi.org/10.1109/ACCESS.2023.3329347)
- \[7\]A\. Founta, C\. Djouvas, D\. Chatzakou, I\. Leontiadis, J\. Blackburn, G\. Stringhini, A\. Vakali, M\. Sirivianos, and N\. Kourtellis, “Large scale crowdsourcing and characterization of twitter abusive behavior,”*Proceedings of the International AAAI Conference on Web and Social Media*, vol\. 12, no\. 1, Jun\. 2018\. \[Online\]\. Available:[http://dx\.doi\.org/10\.1609/icwsm\.v12i1\.14991](http://dx.doi.org/10.1609/icwsm.v12i1.14991)
- \[8\]J\. Wang, K\. Fu, and C\.\-T\. Lu, “Sosnet: A graph convolutional network approach to fine\-grained cyberbullying detection,” in*2020 IEEE International Conference on Big Data \(Big Data\)*\. IEEE, Dec\. 2020, p\. 1699–1708\. \[Online\]\. Available:[http://dx\.doi\.org/10\.1109/bigdata50022\.2020\.9378065](http://dx.doi.org/10.1109/bigdata50022.2020.9378065)
- \[9\]C\. Van Hee, G\. Jacobs, C\. Emmery, B\. Desmet, E\. Lefever, B\. Verhoeven, G\. De Pauw, W\. Daelemans, and V\. Hoste, “Automatic detection of cyberbullying in social media text,”*PLOS ONE*, vol\. 13, no\. 10, p\. e0203794, Oct\. 2018\. \[Online\]\. Available:[http://dx\.doi\.org/10\.1371/journal\.pone\.0203794](http://dx.doi.org/10.1371/journal.pone.0203794)
- \[10\]R\. I\. Rafiq, H\. Hosseinmardi, R\. Han, Q\. Lv, S\. Mishra, and S\. A\. Mattson, “Careful what you share in six seconds: Detecting cyberbullying instances in vine,” in*Proceedings of the 2015 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining 2015*, ser\. ASONAM ’15\. ACM, Aug\. 2015, p\. 617–622\. \[Online\]\. Available:[http://dx\.doi\.org/10\.1145/2808797\.2809381](http://dx.doi.org/10.1145/2808797.2809381)
- \[11\]H\. Hosseinmardi, S\. A\. Mattson, R\. Ibn Rafiq, R\. Han, Q\. Lv, and S\. Mishra,*Analyzing Labeled Cyberbullying Incidents on the Instagram Social Network*\. Springer International Publishing, 2015, p\. 49–66\. \[Online\]\. Available:[http://dx\.doi\.org/10\.1007/978\-3\-319\-27433\-1\_4](http://dx.doi.org/10.1007/978-3-319-27433-1_4)
- \[12\]M\. N\. Hoque, P\. Chakraborty, and M\. H\. Seddiqui, “The challenges and approaches during the detection of cyberbullying text for low\-resource language: A literature review,”*ECTI Transactions on Computer and Information Technology \(ECTI\-CIT\)*, vol\. 17, no\. 2, pp\. 192–214, 2023\. \[Online\]\. Available:[http://dx\.doi\.org/10\.37936/ecti\-cit\.2023172\.248039](http://dx.doi.org/10.37936/ecti-cit.2023172.248039)
- \[13\]N\. Romim, M\. Ahmed, H\. Talukder, and M\. Saiful Islam,*Hate Speech Detection in the Bengali Language: A Dataset and Its Baseline Evaluation*\. Springer Singapore, 2021, p\. 457–468\. \[Online\]\. Available:[http://dx\.doi\.org/10\.1007/978\-981\-16\-0586\-4\_37](http://dx.doi.org/10.1007/978-981-16-0586-4_37)
- \[14\]S\. K\. Lora, G\. M\. Shahariar, T\. Nazmin, N\. N\. Rahman, R\. Rahman, M\. Bhuiyan, and F\. M\. Shah, “Ben\-sarc: A self\-annotated corpus for sarcasm detection from bengali social media comments and its baseline evaluation,”*Natural Language Processing*, vol\. 31, no\. 2, p\. 674–699, May 2024\. \[Online\]\. Available:[http://dx\.doi\.org/10\.1017/nlp\.2024\.11](http://dx.doi.org/10.1017/nlp.2024.11)
- \[15\]M\. N\. Hoque and M\. H\. Seddiqui, “Detecting cyberbullying text using the approaches with machine learning models for the low\-resource bengali language,”*IAES International Journal of Artificial Intelligence \(IJ\-AI\)*, vol\. 13, no\. 1, p\. 358, Mar\. 2024\. \[Online\]\. Available:[http://dx\.doi\.org/10\.11591/ijai\.v13\.i1\.pp358\-367](http://dx.doi.org/10.11591/ijai.v13.i1.pp358-367)
- \[16\]M\. F\. Ahmed, Z\. Mahmud, Z\. T\. Biash, A\. A\. N\. Ryen, A\. Hossain, and F\. B\. Ashraf, “Bangla text dataset and exploratory analysis for online harassment detection,” 2021\. \[Online\]\. Available:[https://arxiv\.org/abs/2102\.02478](https://arxiv.org/abs/2102.02478)
- \[17\]S\. Sihab\-Us\-Sakib, M\. R\. Rahman, M\. S\. A\. Forhad, and M\. A\. Aziz, “Cyberbullying detection of resource constrained language from social media using transformer\-based approach,”*Natural Language Processing Journal*, vol\. 9, p\. 100104, Dec\. 2024\. \[Online\]\. Available:[http://dx\.doi\.org/10\.1016/j\.nlp\.2024\.100104](http://dx.doi.org/10.1016/j.nlp.2024.100104)
- \[18\]M\. N\. Hoque and M\. H\. Seddiqui, “Leveraging transformer models in the cyberbullying text classification system for the low\-resource bengali language,” in*2023 26th International Conference on Computer and Information Technology \(ICCIT\)*\. IEEE, Dec\. 2023, p\. 1–6\. \[Online\]\. Available:[http://dx\.doi\.org/10\.1109/ICCIT60459\.2023\.10441412](http://dx.doi.org/10.1109/ICCIT60459.2023.10441412)
- \[19\]T\. Mahmud, M\. Ptaszynski, and F\. Masui, “Exhaustive study into machine learning and deep learning methods for multilingual cyberbullying detection in bangla and chittagonian texts,”*Electronics*, vol\. 13, no\. 9, p\. 1677, Apr\. 2024\. \[Online\]\. Available:[http://dx\.doi\.org/10\.3390/electronics13091677](http://dx.doi.org/10.3390/electronics13091677)
- \[20\]T\. Islam, N\. Ahmed, and S\. Latif, “An evolutionary approach to comparative analysis of detecting bangla abusive text,”*Bulletin of Electrical Engineering and Informatics*, vol\. 10, no\. 4, p\. 2163–2169, Aug\. 2021\. \[Online\]\. Available:[http://dx\.doi\.org/10\.11591/eei\.v10i4\.3107](http://dx.doi.org/10.11591/eei.v10i4.3107)
- \[21\]K\. M\. Mohi Uddin, H\. Hamim, M\. N\. T\. Mim, A\. Akhter, and M\. A\. Uddin, “Machine learning and deep learning\-based approach to categorize bengali comments on social networks using fused dataset,”*PLOS ONE*, vol\. 19, no\. 10, p\. e0308862, Oct\. 2024\. \[Online\]\. Available:[http://dx\.doi\.org/10\.1371/journal\.pone\.0308862](http://dx.doi.org/10.1371/journal.pone.0308862)
- \[22\]M\. Jahan, I\. Ahamed, M\. R\. Bishwas, and S\. Shatabda, “Abusive comments detection in bangla\-english code\-mixed and transliterated text,” in*2019 2nd International Conference on Innovation in Engineering and Technology \(ICIET\)*\. IEEE, Dec\. 2019, p\. 1–6\. \[Online\]\. Available:[http://dx\.doi\.org/10\.1109/ICIET48527\.2019\.9290630](http://dx.doi.org/10.1109/ICIET48527.2019.9290630)
- \[23\]P\. Chakraborty and M\. H\. Seddiqui, “Threat and abusive language detection on social media in bengali language,” in*2019 1st International Conference on Advances in Science, Engineering and Robotics Technology \(ICASERT\)*\. IEEE, May 2019, p\. 1–6\. \[Online\]\. Available:[http://dx\.doi\.org/10\.1109/icasert\.2019\.8934609](http://dx.doi.org/10.1109/icasert.2019.8934609)
- \[24\]M\. T\. Ahmed, M\. Rahman, S\. Nur, A\. Islam, and D\. Das, “Deployment of machine learning and deep learning algorithms in detecting cyberbullying in bangla and romanized bangla text: A comparative study,” in*2021 International Conference on Advances in Electrical, Computing, Communication and Sustainable Technologies \(ICAECT\)*\. IEEE, Feb\. 2021, p\. 1–10\. \[Online\]\. Available:[http://dx\.doi\.org/10\.1109/ICAECT49130\.2021\.9392608](http://dx.doi.org/10.1109/ICAECT49130.2021.9392608)
- \[25\]Q\. Yang, Y\. Chen, Z\. Xu, Y\.\-m\. Shang, S\. Guo, and X\. Zhang, “SCCD: A session\-based dataset for Chinese cyberbullying detection,” in*Proceedings of the 31st International Conference on Computational Linguistics*\. Association for Computational Linguistics, Jan\. 2025, pp\. 9533–9545\. \[Online\]\. Available:[https://aclanthology\.org/2025\.coling\-main\.639/](https://aclanthology.org/2025.coling-main.639/)
- \[26\]Z\. Waseem, T\. Davidson, D\. Warmsley, and I\. Weber, “Understanding abuse: A typology of abusive language detection subtasks,” in*Proceedings of the First Workshop on Abusive Language Online*\. Association for Computational Linguistics, 2017, p\. 78–84\. \[Online\]\. Available:[http://dx\.doi\.org/10\.18653/v1/W17\-3012](http://dx.doi.org/10.18653/v1/W17-3012)
- \[27\]S\. Bhattacharya, S\. Singh, R\. Kumar, A\. Bansal, A\. Bhagat, Y\. Dawer, B\. Lahiri, and A\. K\. Ojha, “Developing a multilingual annotated corpus of misogyny and aggression,” in*Proceedings of the Second Workshop on Trolling, Aggression and Cyberbullying*, R\. Kumar, A\. K\. Ojha, B\. Lahiri, M\. Zampieri, S\. Malmasi, V\. Murdock, and D\. Kadar, Eds\. Marseille, France: European Language Resources Association \(ELRA\), May 2020, pp\. 158–168\. \[Online\]\. Available:[https://aclanthology\.org/2020\.trac\-1\.25/](https://aclanthology.org/2020.trac-1.25/)
- \[28\]P\. Fortuna and S\. Nunes, “A survey on automatic detection of hate speech in text,”*ACM Computing Surveys*, vol\. 51, no\. 4, p\. 1–30, Jul\. 2018\. \[Online\]\. Available:[http://dx\.doi\.org/10\.1145/3232676](http://dx.doi.org/10.1145/3232676)
- \[29\]W\. Zhang, S\. Huang, L\. Lam, R\. Evans, and C\. Zhu, “Cyberbullying definitions and measurements in children and adolescents: Summarizing 20 years of global efforts,”*Frontiers in Public Health*, vol\. 10, Oct\. 2022\. \[Online\]\. Available:[http://dx\.doi\.org/10\.3389/fpubh\.2022\.1000504](http://dx.doi.org/10.3389/fpubh.2022.1000504)
- \[30\]A\. Vaswani, N\. Shazeer, N\. Parmar, J\. Uszkoreit, L\. Jones, A\. N\. Gomez, Ł\. Kaiser, and I\. Polosukhin, “Attention is all you need,” in*Neural Information Processing Systems*, vol\. 30, 2017\.
- \[31\]A\. Bhattacharjee, T\. Hasan, W\. Ahmad, K\. S\. Mubasshir, M\. S\. Islam, A\. Iqbal, M\. S\. Rahman, and R\. Shahriyar, “Banglabert: Language model pretraining and benchmarks for low\-resource language understanding evaluation in bangla,” in*Findings of the Association for Computational Linguistics: NAACL 2022*\. Association for Computational Linguistics, 2022\. \[Online\]\. Available:[http://dx\.doi\.org/10\.18653/v1/2022\.findings\-naacl\.98](http://dx.doi.org/10.18653/v1/2022.findings-naacl.98)
- \[32\]S\. Doddapaneni, R\. Aralikatte, G\. Ramesh, S\. Goyal, M\. M\. Khapra, A\. Kunchukuttan, and P\. Kumar, “Towards leaving no indic language behind: Building monolingual corpora, benchmark and models for indic languages,” in*Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\)*\. Association for Computational Linguistics, 2023, p\. 12402–12426\. \[Online\]\. Available:[http://dx\.doi\.org/10\.18653/v1/2023\.acl\-long\.693](http://dx.doi.org/10.18653/v1/2023.acl-long.693)
- \[33\]J\. Devlin, M\.\-W\. Chang, K\. Lee, and K\. Toutanova, “Bert: Pre\-training of deep bidirectional transformers for language understanding,” in*Proceedings of the 2019 Conference of the North*\. Association for Computational Linguistics, 2019, p\. 4171–4186\. \[Online\]\. Available:[http://dx\.doi\.org/10\.18653/v1/N19\-1423](http://dx.doi.org/10.18653/v1/N19-1423)
- \[34\]A\. Conneau, K\. Khandelwal, N\. Goyal, V\. Chaudhary, G\. Wenzek, F\. Guzmán, E\. Grave, M\. Ott, L\. Zettlemoyer, and V\. Stoyanov, “Unsupervised cross\-lingual representation learning at scale,” in*Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics*\. Association for Computational Linguistics, 2020, p\. 8440–8451\. \[Online\]\. Available:[http://dx\.doi\.org/10\.18653/v1/2020\.acl\-main\.747](http://dx.doi.org/10.18653/v1/2020.acl-main.747)
- \[35\]M\. N\. Hoque, R\. P\. Deb Nath, A\. N\. Chy, D\. Ghose, and M\. H\. Seddiqui, “Advancing cyberbullying detection in low\-resource languages: a transformer\-stacking framework for bengali,”*Frontiers in Artificial Intelligence*, vol\. 8, Jan\. 2026\. \[Online\]\. Available:[http://dx\.doi\.org/10\.3389/frai\.2025\.1679962](http://dx.doi.org/10.3389/frai.2025.1679962)