shiqiwang

SHIQI WANG

I am an applied research scientist at AWS AI Lab (Amazon NYC) now working on reliability, AI safety, and trustworthiness of Large Language Model (LLM). Currently, I am leading the robustness research of AWS product CodeWhisperer (LLM for Code Generation). I completed my Ph.D. at the Department of Computer Science at Columbia University, advised by Professor Suman Jana. Before coming to Columbia, I received B.Eng. from Shanghai Jiao Tong University in 2017. I am interested in improving the reliability and robustness of machine learning systems and solving traditional program problems with the help of machine learning.

Mail: wshiqi (AT) amazon.com; tcwangshiqi (AT) gmail.com; (tcwangshiqi (AT) cs.columbia.edu)

↳ Google Scholar    ↳ Github     ↳ LinkedIn     ↳ DBLP

NEWS

I am one of the main speakers for AAAI 2022 Tutorial
Formal Verification of Deep Neural Networks: Theory and Practice [tutorial webpage]

Our paper won the CCS 2021 Best Paper Award Runner-Up
Learning Security Classifiers with Verified Global Robustness Properties [code link]

I am one of the main contributors to alpha-beta-CROWN, the global winner of VNN-COMP 2021
the 2nd International Verification of Neural Networks Competition
[alpha-beta-CROWN code] [competition report] [certificate] [alpha-beta-CROWN logo]

I co-organized ATVA 2021 Workshop on Security and Reliablity of Machine Learning (SRML)




WORK EXPERIENCES

AWS AI Lab - CodeWhisperer (NYC, US, full-time, May 2022 - Present).

Applied Science Group (ASG) - Microsoft Research (Redmond, US, 2021 summer), working with Hamid Vaezi Joze, and Wedward Wei.

Cyber Security Intelligence (CSI) Team - IBM Research (Yorktown Height, US, 2020 summer), working with Kevin Eykholt, Taesung Lee, Jiyong Jang, and Ian Molloy.

Baidu Security X-Lab (Sunnyvale, US, 2019 summer), working with Yunhan Jia, Zhenyu Zhong, Yantao Lu.




PUBLICATIONS

"ReCode: Robustness Evaluation of Code Generation Models"
Shiqi Wang*, Zheng Li*, Haifeng Qian, Mingyue Shang, Chenghao Yang, Zijian Wang, Varun Kumar, Samson Tan, Baishakhi Ray, Parminder Bhatia, Ramesh Nallapati, Murali Krishna Ramanathan, Dan Roth, Bing Xiang (* indicates equal contribution)
↳ 61st Annual Meeting of the Association for Computational Linguistics (ACL 2023)
ACL 2023 best paper recommendation in meta review
↳ also accepted to ICLR 2023 Deep Learning for Code (DL4C) workshop
Science Blog post regarding ReCode

"Greener yet Powerful: Taming Large Code Generation Models with Quantization"
Xiaokai Wei, Sujan Gonugondla, Shiqi Wang, Wasi Ahmad, Baishakhi Ray, Haifeng Qian, Xiaopeng Li, Varun Kumar, Zijian Wang, Yuchen Tian, Qing Sun, Ben Athiwaratkun, Mingyue Shang, Murali Krishna Ramanathan, Parminder Bhatia, Bing Xiang
↳ Symposium on the Foundations of Software Engineering (FSE 2023)

"Are diffusion models vulnerable to membership inference attacks?"
Jinhao Duan, Fei Kong, Shiqi Wang, Xiaoshuang Shi, Kaidi Xu
↳ 40th International Conference on Machine Learning (ICML 2023)

"Multi-lingual Evaluation of Code Generation Models"
Ben Athiwaratkun, Sanjay Gouda, Zijian Wang, Xiaopeng Li, Yuchen Tian, Ming Tan, Wasi Ahmad, Shiqi Wang, Qing Sun, Mingyue Shang, Sujan Kumar Gonugondla, Hantian Ding, Varun Kumar, Nathan Fulton, Arash Farahani, Siddhartha Jain, Robert Giaquinto, Haifeng Qian, Murali Krishna Ramanathan, Ramesh Nallapati, Baishakhi Ray, Parminder Bhatia, Sudipta Sengupta, Dan Roth, Bing Xiang
↳ 10th International Conference on Learning Representations (ICLR 2023)

"General Cutting Planes for Bound-Propagation-Based Neural Network Verification"
Huan Zhang*, Shiqi Wang*, Kaidi Xu*, Linyi Li, Bo Li, Suman Jana, Cho-Jui Hsieh, Zico Kolter (* indicates equal contribution)
↳ 36th Conference on Neural Information Processing Systems (NeurIPS 2022)[GCP-CROWN code]

"A Branch and Bound Framework for Stronger Adversarial Attacks of ReLU Networks"
Huan Zhang*, Shiqi Wang*, Kaidi Xu, Yihan Wang, Suman Jana, Cho-Jui Hsieh, Zico Kolter (* indicates equal contribution)
↳ 39th International Conference on Machine Learning (ICML 2022)

"Beta-CROWN: Efficient Bound Propagation with Per-neuron Split Constraints for Complete and Incomplete Neural Network Verification"
Shiqi Wang*, Huan Zhang*, Kaidi Xu*, Xue Lin, Suman Jana, Cho-Jui Hsieh, J. Zico Kolter (* indicates equal contribution)
ICML 2021 Workshop AML

↳ 35th Conference on Neural Information Processing Systems (NeurIPS 2021)[beta-CROWN code]
The global winner of 2nd International Verification of Neural Networks Competition (VNN-COMP 2021)[alpha-beta-CROWN code]

"Learning Security Classifiers with Verified Global Robustness Properties"
Yizheng Chen, Shiqi Wang, Yue Qin, Xiaojing Liao, Suman Jana, and David Wagner
↳ 28th ACM Conference on Computer and Communications Security (CCS 2021) [code]
Best Paper Award Runner-Up

"Fast and Complete: Enabling Complete Neural Network Verification with Rapid and Massively Parallel Incomplete Verifiers"
Kaidi Xu*, Huan Zhang*, Shiqi Wang, Yihan Wang, Suman Jana, Xue Lin, Cho-Jui Hsieh (* indicates equal contribution)
↳ 9th International Conference on Learning Representations (ICLR 2021 )[poster]

"Adaptive Verifiable Training Using Pairwise Class Similarity"
Shiqi Wang, Kevin Eykholt, Taesung Lee, Jiyong Jang, Ian Molloy
↳ 35th AAAI Conference on Artifical Intelligence (AAAI 2021, acceptance rate: 21%)[poster]

"Cost-Aware Robust Tree Ensembles for Security Applications"
Yizheng Chen, Shiqi Wang, Weifan Jiang, Asaf Cidon, Suman Jana
↳30th USENIX Security Symposium (Usenix Security 2021 ).

"On Pruning Adversarially Robust Neural Networks"
Vikash Sehwag, Shiqi Wang, Prateek Mittal, Suman Jana
↳ 34th Conference on Neural Information Processing Systems (NeurIPS 2020, acceptance rate: 20.1%)[HYDRA code][poster]
↳ also appears in ICLR 2020 workshop on Trustworthy ML


"On Training Robust PDF Malware Classifiers"
Yizheng Chen, Shiqi Wang, Dongdong She, Suman Jana
↳ 29th USENIX Security Symposium (Usenix Security 2020).

"Enhancing Gradient-based Attacks with Symbolic Intervals"
Shiqi Wang, Yizheng Chen, Ahmed Abdou, Suman Jana
↳ ICML 2019 Workshop on Security and Privacy of Machine Learning (contributed talk in SPML 2019, acceptance rate: 4/68=5.8%)[Interval attacks code][poster]
↳ Interval attacks appear on MadryLab MNIST Challenge Leaderboard.


"Efficient Formal Safety Analysis of Neural Networks"
Shiqi Wang, Kexin Pei, Justin Whitehouse, Junfeng Yang, Suman Jana
↳ 32th Conference on Neural Information Processing Systems (NeurIPS 2018 acceptance rate: 20.8%)[Neurify code][poster][video].

"Formal Security Analysis of Neural Networks using Symbolic Intervals"
Shiqi Wang, Kexin Pei, Justin Whitehouse, Junfeng Yang, Suman Jana
↳ 27th USENIX Security Symposium (USENIX Security 2018, acceptance rate: 19%)[ReluVal code][video].

"ContexIot: Towards Providing Contextual Integrity to Appified IoT platforms"
Yunhan Jack Jia, Qi Alfred Chen, Shiqi Wang, Amir Rahmati, Earlence Fernandes, Z. Morley Mao, Atul Prakash
↳ Proceedings of the 21st Network and Distributed System Security Symposium (NDSS 2017, acceptance rate: 16%). (Undergraduate Research)

"Defense against impersonating attackers: An efficient RFID mutual authentication protocol based on standard"
Shiqi Wang, Linsen Li, Gaosheng Chen, Tao Chen, Zeming Wang
↳ 8th International Conference on Information and Communication Systems (ICICS 2017). (Undergraduate Research)

"Improved Group Management Protocol of RFID password Method"
Tao Chen, Linsen Li, Shiqi Wang, Gaosheng Chen, Zeming Wang
↳ International Conference on Internet of Things, Data and Cloud Computing (ICC 2017). (Undergraduate Research)




PREPRINTS

"Shifting Attention to Relevance: Towards the Uncertainty Estimation of Large Language Models"
Jinhao Duan, Hao Cheng, Shiqi Wang, Chenan Wang, Alex Zavalny, Renjing Xu, Bhavya Kailkhura, Kaidi Xu

"Towards Understanding Fast Adversarial Training"
Bai Li, Shiqi Wang, Suman Jana, Lawrence Carin

"MixTrain: Scalable Training of Verifiably Robust Neural Networks"
Shiqi Wang, Yizheng Chen, Ahmed Abdou, Suman Jana
↳ Our symbolic interval analysis library has been incorporated into Perceptron, an adversarial toolbox for benchmarking various safety and security properties of deep neural networks at Baidu Security X-Lab.

"Towards Practical Lottery Ticket Hypothesis for Adversarial Training"
Bai Li*,Shiqi Wang*, Yunhan Jia, Yantao Lu, Zhenyu Zhong, Lawrence Carin, Suman Jana (* indicates equal contribution)

"Towards Compact and Robust Deep Neural Networks"
Vikash Sehwag*, Shiqi Wang*, Prateek Mittal, Suman Jana (* indicates equal contribution)




PATENTS

"Book management method based on color rectangular code and color rectangular code label" (CN106919966A).
Linsen Li, Shiqi Wang, Junhua Tang, Yue Wu, Jianhua Li (Undergraduate Research)




Ph.D. Thesis

"Efficient Neural Network Verification Using Branch and Bound".




ACADEMIA SERVICES

Conference PC/Reviewer: NeurIPS (2020, 2021, 2022, 2023), ICML (2021, 2022, 2023), ICLR (2022, 2023), AAAI (2022, 2023), AISec (2021, 2022, 2023), WFVML 2022, MAPS 2023.
Journal Reviewer: TMLR; TNNLS; SAS; Algorithms; Entropy.
AAAI 2022 Tutorial Organizers: Formal Verification of Deep Neural Networks: Theory and Practice [tutorial webpage]
Workshop Organizers: ATVA 2021 Workshop on Security and Reliability of Machine Learning (SRML).




MORE ABOUT ME

I am a national second-level basketball player basketball .
I am also a Physique athlete since 2022 bodybuilding.
If you love Shiba Inu nikki , definitely worth taking a look at Nikki's Instagram.
If you love flower design, check my wife's page @wildpetals_ny!




LINKS

↳ Google Scholar    ↳ Github    ↳ DBLP     ↳ Facebook    ↳ LinkedIn     ↳ Instagram