2 citations · 3 across the 9 of their papers we have counts for
4 papers · 1 filter
PromptKeeper: Safeguarding System Prompts for LLMs
Zhifeng Jiang, Zhihua Jin, Guoliang He
System prompts are widely used to guide the outputs of large language models (LLMs). These prompts often contain business logic and sensitive information, making their protection e…
Optimizing Tensor Computation Graphs with Equality Saturation and Monte Carlo Tree Search
Jakob Hartmann, Guoliang He, Eiko Yoneki
The real-world effectiveness of deep neural networks often depends on their latency, thereby necessitating optimization techniques that can reduce a model's inference time while pr…
vPALs: Towards Verified Performance-aware Learning System For Resource Management
Guoliang He, Gingfung Yeung, Sheriffo Ceesay +1
Accurately predicting task performance at runtime in a cluster is advantageous for a resource management system to determine whether a task should be migrated due to performance de…
SIP: Autotuning GPU Native Schedules via Stochastic Instruction Perturbation
Guoliang He, Eiko Yoneki
Large language models (LLMs) have become a significant workload since their appearance. However, they are also computationally expensive as they have billions of parameters and are…