MLRIP: Pre-training a military language representation model with informative factual knowledge and professional knowledge base

Hui Li, Xuekang Yang

Incorporating structured knowledge into pre-trained language models has demonstrated signiffcant bene-ffts for domain-speciffc natural language processing tasks, particularly in sp…