Hi, I'm a machine learning engineer / data scientist focusing/focused on: LLM, NLP, recommender system, quantitative finance.

Less talking more coding:

• Open Source Contributions

  • huggingface/transformers
  • OpenNMT/Tokenizer
  • yanyiwu/simhash

• Side Projects

  • simpler-distil-whisper: Reproduce paper Distil-Whisper: Robust Knowledge Distillation via Large-Scale Pseudo Labelling.
  • PLM-ICD-multi-label-classifier: Reproduce paper PLM-ICD: Automatic ICD Coding with Pretrained Language Models.
  • SlimPajama-DC Data Deduplicator: Reproduce paper SlimPajama-DC: Understanding Data Combinations for LLM Training.
  • feather: A C++ feature-hash lib with Python binding provided.
  • osimhash: A Python binder over simhash C++ text deduplication lib.
  • pypack: Generates Python runtime tar.gz file (for PySpark) runnable on all python-version/os/platforms.

• Learning

  • fastTextAnnotation: The very detailed code annotation for facebook fasttext lib.
  • hnswlibAnnotation: The very detailed code annotation for hnswlib.
  • finBERT: BERT for financial news sentiment classification.

• Personal Using

  • quicmd: Some useful quickly execution commands.
  • config4: Some self-using configs, for now about tmux and vim.
  • wiki4codes: Some lib/framework/algorithms/models' trials recording, demos, examples, etc...