Some of my projects, tools and scripts

Published: 四 08 十月 2020
By jlz

In CV.

HTTP traffic index engine

  • design and implement an HTTP request hash algorithm to filter similar HTTP request(from penetration testing perspective)
  • design and implement a web page structural clustering algorithm to filter similar web page(from penetration testing perspective)
  • design and implement a crawler-based on these two algorithms to index HTTP traffic

web attack detection using Machine Learning

  • collect web attack payloads, including SQL injection payloads, XSS payloads, command injection payloads, XXE payloads, some other RCE payloads like s2-045, and normal HTTP traffic
  • test multiple different Machine Learning classification algorithms' false-positive rate and false-negative rate, implemented the most efficient and acceptable model

high-frequency futures trading bot

  • implement order imbalance algorithm
  • test on multiple futures instruments, some work, some not
  • working on implementing high market access

leetcode problem Python solutions

  • many leetcode problems' Python solutions

LD_PRELOAD based user-space educational Linux rootkit

  • can hide file, process, user
  • supports both 32-bit and 64-bit system calls
  • works on all distributions
  • works on all kernel versions(since it is user-space, no need to worry about kernel versions)
  • cons: does not work for statically linked binaries

captcha solver using Deep Learning(based on LSTM and CTC loss)

  • tried years to do this using traditional computer vision algorithms, well, results were not good
  • after deep learning evolved to a more mature stage and CTC loss was introduced, solved it in no time

Python source code obfuscation tool

  • parse abstract syntax tree(it is very easy to do this in Python)
  • manipulate tree node, like, split a meaningful string to multiple meaningless numbers, add no-op code, etc

multiple POCs

  • multiple struts2 RCE pocs
  • solr RCE poc

fast and secure file transfer tool in a high packet loss environment

  • password protected upload point
  • segment file into chunks
  • multi-thread transfer
  • packet timeout and re-transfer

gnome desktop environment init tool

  • convenient and flexible
  • run commands in gnome-terminal
  • Chrome, telegram, nautilus, atom, calibre, bitwarden
  • some GUI automation helpers

quantitative trading utils

  • time and time range utils
  • plot volume and price
  • load,clean,transform tick data
  • sample history data

Python script "compile" tool

  • "compile" a script to a one-file binary using pyinstaller
  • clean up intermediate files

youtube music library no-copyright-music downloader

  • parse youtube music library web page and API request
  • extract no-copyright-music URLs
  • download and save to files

others

  • tmux session init tool
  • cloudflare nodes latency test and record tool
  • videos to music converting tool
  • PE(portable executable) analysis tool
  • v2ray config generation tool
  • Internet speed test and record tool
  • backup automation tool
  • time series data animation tool
  • markdown to pdf automation tool
  • GPA calculation tool
  • video process automation tool

links

social