25 citations · 43 across the 6 of their papers we have counts for
8 papers
Do not Mask Randomly: Effective Domain-adaptive Pre-training by Masking In-domain Keywords
Shahriar Golchin, Mihai Surdeanu, Nazgol Tavabi +1
We propose a novel task-agnostic in-domain pre-training method that sits between generic pre-training and fine-tuning. Our approach selectively masks in-domain keywords, i.e., word…
A Compact Pretraining Approach for Neural Language Models
Shahriar Golchin, Mihai Surdeanu, Nazgol Tavabi +1
Domain adaptation for large neural language models (NLMs) is coupled with massive amounts of unstructured data in the pretraining phase. In this study, however, we show that pretra…
Pattern Discovery in Time Series with Byte Pair Encoding
Nazgol Tavabi, Kristina Lerman
The growing popularity of wearable sensors has generated large quantities of temporal physiological and activity data. Ability to analyze this data offers new opportunities for rea…
Having a Bad Day? Detecting the Impact of Atypical Life Events Using Wearable Sensors
Keith Burghardt, Nazgol Tavabi, Emilio Ferrara +2
Life events can dramatically affect our psychological state and work performance. Stress, for example, has been linked to professional dissatisfaction, increased anxiety, and workp…
Challenges in Forecasting Malicious Events from Incomplete Data
Nazgol Tavabi, Andrés Abeliuk, Negar Mokhberian +2
The ability to accurately predict cyber-attacks would enable organizations to mitigate their growing threat and avert the financial losses and disruptions they cause. But how predi…
Learning Behavioral Representations from Wearable Sensors
Nazgol Tavabi, Homa Hosseinmardi, Jennifer L. Villatte +4
Continuous collection of physiological data from wearable sensors enables temporal characterization of individual behaviors. Understanding the relation between an individual's beha…
Characterizing Activity on the Deep and Dark Web
Nazgol Tavabi, Nathan Bartley, Andrés Abeliuk +3
The deep and darkweb (d2web) refers to limited access web sites that require registration, authentication, or more complex encryption protocols to access them. These web sites serv…
Discovering Signals from Web Sources to Predict Cyber Attacks
Palash Goyal, KSM Tozammel Hossain, Ashok Deb +5
Cyber attacks are growing in frequency and severity. Over the past year alone we have witnessed massive data breaches that stole personal information of millions of people and wide…