What is it?
This repository is a collection of various materials and tools that I use every day in my work. It contains a lot of useful information gathered in one piece. It is an invaluable source of knowledge for me that I often look back on.
The Book of
Secret Knowledge
"Knowledge is powerful, be careful how you use it!"
908+
curated resources
15
chapters
155
categories
260
shell one-liners
## about
What is it?
For whom?
For everyone, really. Here everyone can find their favourite tastes. But to be perfectly honest, it is aimed towards System and Network administrators, DevOps, Pentesters, and Security Researchers.
Contributing
If you find something which doesn't make sense, or something doesn't seem right, please make a pull request and please add valid and well-reasoned explanations about your changes or comments.
A few simple rules for this project:
- inviting and clear
- not tiring
- useful
These below rules may be better:
- easy to contribute to (Markdown + HTML ...)
- easy to find (simple TOC, maybe it's worth extending them?)
Url marked \* is temporary unavailable. Please don't delete it without confirming that it has permanently expired.
Before adding a pull request, please see the contributing guidelines. You should also remember about this:
RSS Feed & Updates
GitHub exposes an RSS/Atom feed of the commits, which may also be useful if you want to be kept informed about all changes.
ToDo
- [ ] Add new stuff...
- [ ] Add useful shell functions
- [ ] Add one-liners for collection tools (eg. CLI Tools)
- [ ] Sort order in lists
New items are also added on a regular basis.
## toc
Chapters
CLI Tools
#Shells
GNU Bashis an sh-compatible shell that incorporates useful features from the Korn shell and C shell.gnu.orgZshis a shell designed for interactive use, although it is also a powerful scripting language.zsh.orgtclshis a very powerful cross-platform shell, suitable for a huge range of uses.tcl-lang.orgbash-itis a framework for using, developing and maintaining shell scripts and custom commands.github.comOh My ZSH!is the best framework for managing your Zsh configuration.ohmyz.shOh My Fishthe Fishshell framework.github.comStarshipthe cross-shell prompt written in Rust.github.compowerlevel10kis a fast reimplementation of Powerlevel9k ZSH theme.github.com
#Shell plugins
ztracks the folder you use the most and allow you to jump, without having to type the whole path.github.comfzfis a general-purpose command-line fuzzy finder.github.comzsh-autosuggestionsFish-like autosuggestions for Zsh.github.comzsh-syntax-highlightingFish shell like syntax highlighting for Zsh.github.comAwesome ZSH PluginsA list of frameworks, plugins, themes and tutorials for ZSH.github.com
#Managers
Midnight Commanderis a visual file manager, licensed under GNU General Public License.midnight-commander.orgrangeris a VIM-inspired filemanager for the console.github.comnnnis a tiny, lightning fast, feature-packed file manager.github.comscreenis a full-screen window manager that multiplexes a physical terminal.gnu.orgtmuxis a terminal multiplexer, lets you switch easily between several programs in one terminal.github.comtmux-csshis a tool to set comfortable and easy to use functionality tmux-sessions.github.com
#Text editors
viis one of the most common text editors on Unix.ex-vi.sourceforge.netvimis a highly configurable text editor.vim.orgemacsis an extensible, customizable, free/libre text editor, and more.gnu.orgmicrois a modern and intuitive terminal-based text editor.github.comneovimis a free open source, powerful, extensible and usable code editor.neovim.iospacemacsa community-driven Emacs distribution.spacemacs.orgspacevima community-driven vim distribution.spacevim.org
#Files and directories
#Network
PuTTYis an SSH and telnet client, developed originally by Simon Tatham.putty.orgMoshis a SSH wrapper designed to keep a SSH session alive over a volatile connection.mosh.orgEternal Terminalenables mouse-scrolling and tmux commands inside the SSH session.eternalterminal.devnmapis a free and open source (license) utility for network discovery and security auditing.nmap.orgzmapis a fast single packet network scanner designed for Internet-wide network surveys.github.comRust Scanto find all open ports faster than Nmap.github.commasscanis the fastest Internet port scanner, spews SYN packets asynchronously.github.compbscanis a faster and more efficient stateless SYN scanner and banner grabber.github.comhpingis a command-line oriented TCP/IP packet assembler/analyzer.hping.orgmtris a tool that combines the functionality of the 'traceroute' and 'ping' programs in a single tool.github.commylgutility which combines the functions of the different network probes in one diagnostic tool.github.comnetcatutility which reads and writes data across network connections, using the TCP/IP protocol.netcat.sourceforge.netsocatutility which transfers data between two objects.dest-unreach.orgtcpdumpis a powerful command-line packet analyzer.tcpdump.orgtsharkis a tool that allows us to dump and analyze network traffic (wireshark cli).wireshark.orgTermsharkis a simple terminal user-interface for tshark.termshark.iongrepis like GNU grep applied to the network layer.github.comnetsniff-ngis a Swiss army knife for your daily Linux network plumbing if you will.netsniff-ng.orgsockdumpdump unix domain socket traffic.github.comstenographeris a packet capture solution which aims to quickly spool all packets to disk.github.comtcptermvisualize packets in TUI.github.combmonis a monitoring and debugging tool to capture networking related statistics and prepare them visually.github.comiptraf-ngis a console-based network monitoring program for Linux that displays information about IP traffic.iptraf.seul.orgvnstatis a network traffic monitor for Linux and BSD.github.comiPerf3is a tool for active measurements of the maximum achievable bandwidth on IP networks.iperf.frethris a Network Performance Measurement Tool for TCP, UDP & HTTP.github.comEtherateis a Linux CLI based Ethernet and MPLS traffic testing tool.github.comechoipis a IP address lookup service.github.comNemesispacket manipulation CLI tool; craft and inject packets of several protocols.github.compacketfua mid-level packet manipulation library for Ruby.github.comScapypacket manipulation library; forge, send, decode, capture packets of a wide number of protocols.scapy.netimpacketis a collection of Python classes for working with network protocols.github.comssh-auditis a tool for SSH server auditing.github.comaria2is a lightweight multi-protocol & multi-source command-line download utility.aria2.github.ioiptables-tracerobserve the path of packets through the iptables chains.github.cominceptiona highly configurable tool to check for whatever you like against any number of hosts.github.commRemoteNGa fork of mRemote, multi-tabbed PuTTy on steroids!mremoteng.org
#Network (DNS)
dnsdiagis a DNS diagnostics and performance measurement tools.github.comfierceis a DNS reconnaissance tool for locating non-contiguous IP space.github.comsubfinderis a subdomain discovery tool that discovers valid subdomains for websites.github.comsublist3ris a fast subdomains enumeration tool for penetration testers.github.comamassis tool that obtains subdomain names by scraping data sources, crawling web archives, and more.github.comnamebenchprovides personalized DNS server recommendations based on your browsing history.github.commassdnsis a high-performance DNS stub resolver for bulk lookups and reconnaissance.github.comknockis a tool to enumerate subdomains on a target domain through a wordlist.github.comdnsperfDNS performance testing tools.github.comdnscrypt-proxy 2a flexible DNS proxy, with support for encrypted DNS protocols.github.comdnsdbqAPI client providing access to passive DNS database systems.github.comgrimdfast dns proxy, built to black-hole internet advertisements and malware servers.github.comdnstwistdetect typosquatters, phishing attacks, fraud, and brand impersonation.github.com
#Network (HTTP)
curlis a command line tool and library for transferring data with URLs.curl.haxx.sekurlyis an alternative to the widely popular curl program, written in Golang.gitlab.comHTTPieis an user-friendly HTTP client.github.comwuzzis an interactive cli tool for HTTP inspection.github.comh2specis a conformance testing tool for HTTP/2 implementation.github.comh2tis a simple tool to help sysadmins to hardening their websites.github.comhtrace.shis a simple Swiss Army knife for http/https troubleshooting and profiling.github.comhttpstatis a tool that visualizes curl statistics in a way of beauty and clarity.github.comhttplabis an interactive web server.github.comLynxis a text browser for the World Wide Web.lynx.browser.orgBrowshis a fully interactive, real-time, and modern text-based browser.github.comHeadlessBrowsersa list of (almost) all headless web browsers in existence.github.comabis a single-threaded command line tool for measuring the performance of HTTP web servers.httpd.apache.orgsiegeis an http load testing and benchmarking utility.joedog.orgwrkis a modern HTTP benchmarking tool capable of generating significant load.github.comwrk2is a constant throughput, correct latency recording variant of wrk.github.comvegetais a constant throughput, correct latency recording variant of wrk.github.combombardieris a fast cross-platform HTTP benchmarking tool written in Go.github.comgobenchhttp/https load testing and benchmarking tool.github.comheyHTTP load generator, ApacheBench (ab) replacement, formerly known as rakyll/boom.github.comboomis a script you can use to quickly smoke-test your web app deployment.github.comSlowHTTPTestis a tool that simulates some Application Layer Denial of Service attacks by prolonging HTTP.github.comgobusteris a free and open source directory/file & DNS busting tool written in Go.github.comssllabs-scancommand-line reference-implementation client for SSL Labs APIs.github.comhttp-observatoryMozilla HTTP Observatory cli version.github.comHurlis a command line tool to run and test HTTP requests with plain text.hurl.dev
#SSL
opensslis a robust, commercial-grade, and full-featured toolkit for the TLS and SSL protocols.openssl.orggnutls-cliclient program to set up a TLS connection to some other computer.gnutls.orgsslyzefast and powerful SSL/TLS server scanning library.github.comsslscantests SSL/TLS enabled services to discover supported cipher suites.github.comtestssl.shtesting TLS/SSL encryption anywhere on any port.github.comcipherscana very simple way to find out which SSL ciphersuites are supported by a target.github.comspipedis a utility for creating symmetrically encrypted and authenticated pipes between socket addresses.tarsnap.comCertbotis EFF's tool to obtain certs from Let's Encrypt and (optionally) auto-enable HTTPS on your server.github.commkcertsimple zero-config tool to make locally trusted development certificates with any names you'd like.github.comcertstraptools to bootstrap CAs, certificate requests, and signed certificates.github.comSublertis a security and reconnaissance tool to automatically monitor new subdomains.github.commkchainopen source tool to help you build a valid SSL certificate chain.github.comssl-cert-checkSSL Certification Expiration Checker.github.com
#Security
SELinuxprovides a flexible Mandatory Access Control (MAC) system built into the Linux kernel.access.redhat.comAppArmorproactively protects the operating system and applications from external or internal threats.wiki.ubuntu.comgrapheneXAutomated System Hardening Framework.github.comDevSec Hardening FrameworkSecurity + DevOps: Automatic Server Hardening.github.com
#Auditing Tools
ossecactively monitoring all aspects of system activity with file integrity monitoring.ossec.netauditdprovides a way to track security-relevant information on your system.access.redhat.comTigeris a security tool that can be use both as a security audit and intrusion detection system.nongnu.orgLynisbattle-tested security tool for systems running Linux, macOS, or Unix-based operating system.cisofy.comLinEnumscripted Local Linux Enumeration & Privilege Escalation Checks.github.comRkhunterscanner tool for Linux systems that scans backdoors, rootkits and local exploits on your systems.github.comPE-sieveis a light-weight tool that helps to detect malware running on the system.github.comPEASSprivilege escalation tools for Windows and Linux/Unix and MacOS.github.com
#System Diagnostics/Debuggers
stracediagnostic, debugging and instructional userspace utility for Linux.github.comDTraceis a performance analysis and troubleshooting tool.dtrace.orgltraceis a library call tracer, used to trace calls made by programs to library functions.en.wikipedia.orgptrace-burritois a friendly wrapper around ptrace.github.comperf-toolsperformance analysis tools based on Linux perf_events (aka perf) and ftrace.github.combpftracehigh-level tracing language for Linux eBPF.github.comsysdigsystem exploration and troubleshooting tool with first class support for containers.github.comValgrindis an instrumentation framework for building dynamic analysis tools.valgrind.orggperftoolshigh-performance multi-threaded malloc() implementation, plus some performance analysis tools.github.comglancescross-platform system monitoring tool written in Python.nicolargo.github.iohtopinteractive text-mode process viewer for Unix systems. It aims to be a better 'top'.github.combashtopLinux resource monitor written in pure Bash.github.comnmona single executable for performance monitoring and data analysis.nmon.sourceforge.netatopASCII performance monitor. Includes statistics for CPU, memory, disk, swap, network, and processes.atoptool.nllsofdisplays in its output information about files that are opened by processes.en.wikipedia.orgFlameGraphstack trace visualizer.brendangregg.comlsofgraphconvert Unix lsof output to a graph showing FIFO and UNIX interprocess communication.github.comrris a lightweight tool for recording, replaying and debugging execution of applications.github.comPerformance Co-Pilota system performance analysis toolkit.pcp.iohexyla command-line hex viewer.github.comAustinPython frame stack sampler for CPython.github.com
#Log Analyzers
#Databases
usqluniversal command-line interface for SQL databases.github.compgclipostgres CLI with autocompletion and syntax highlighting.github.commycliterminal client for MySQL with autocompletion and syntax highlighting.github.comlitecliSQLite CLI with autocompletion and syntax highlighting.github.commssql-cliSQL Server CLI with autocompletion and syntax highlighting.github.comOSQueryis a SQL powered operating system instrumentation, monitoring, and analytics framework.github.compgsyncsync data from one Postgres database to another.github.comiredisa terminal client for redis with autocompletion and syntax highlighting.github.comSchemaCrawlergenerates an E-R diagram of your database.schemacrawler.com
#TOR
#Messengers/IRC Clients
#Productivity
#Other
sysadmin-utiltools for Linux/Unix sysadmins.github.comincronis an inode-based filesystem notification technology.inotify.aiken.czlsyncdsynchronizes local directories with remote targets (Live Syncing Daemon).github.comGRVis a terminal based interface for viewing Git repositories.github.comTigtext-mode interface for Git.jonas.github.iotldrsimplified and community-driven man pages.github.comarchivereasily create and extract .zip, .tar, .tar.gz, .tar.bz2, .tar.xz, .tar.lz4, .tar.sz, and .rar.github.comcommander.jsminimal CLI creator in JavaScript.github.comgronmake JSON greppable!github.combedbinary editor written in Go.github.com
GUI Tools
#Terminal emulators
Guakeis a dropdown terminal made for the GNOME desktop environment.github.comTerminatoris based on GNOME Terminal, useful features for sysadmins and other users.gnometerminator.blogspot.comKittyis a GPU based terminal emulator that supports smooth scrolling and images.sw.kovidgoyal.netAlacrittyis a fast, cross-platform, OpenGL terminal emulator.github.com
#Network
Wiresharkis the world’s foremost and widely-used network protocol analyzer.wireshark.orgEttercapis a comprehensive network monitor tool.ettercap-project.orgEtherApeis a graphical network monitoring solution.etherape.sourceforge.ioPacket Senderis a networking utility for packet generation and built-in UDP/TCP/SSL client and servers.packetsender.comOstinatois a packet crafter and traffic generator.ostinato.orgJMeter™open source software to load test functional behavior and measure performance.jmeter.apache.orglocustscalable user load testing tool written in Python.github.com
#Browsers
#Password Managers
#Messengers/IRC Clients
#Messengers (end-to-end encryption)
Signalis an encrypted communications app.signal.orgWiresecure messaging, file sharing, voice calls and video conferences.wire.comTorChatdecentralized anonymous instant messenger on top of Tor Hidden Services.github.comMatrixan open network for secure, decentralized, real-time communication.matrix.org
#Text editors
Web Tools
#Browsers
SSL/TLS Capabilities of Your Browsertest your browser's SSL implementation.ssllabs.comCan I useprovides up-to-date browser support tables for support of front-end web technologies.caniuse.comPanopticlick 3.0is your browser safe against tracking?panopticlick.eff.orgPrivacy Analyzersee what data is exposed from your browser.privacy.netWeb Browser Securityit's all about Web Browser fingerprinting.browserleaks.comHow's My SSL?help a web server developer learn what real world TLS clients were capable of.howsmyssl.comsslClientInfoclient test (incl TLSv1.3 information).suche.org
#SSL/Security
SSLLabs Server Testperforms a deep analysis of the configuration of any SSL web server.ssllabs.comSSLLabs Server Test (DEV)performs a deep analysis of the configuration of any SSL web server.dev.ssllabs.comImmuniWeb® SSLScantest SSL/TLS (PCI DSS, HIPAA and NIST).immuniweb.comSSL Checkscan your website for non-secure content.jitbit.comSSL Scanneranalyze website security.ssltools.comCryptChecktest your TLS server configuration (e.g. ciphers).cryptcheck.frurlscan.ioservice to scan and analyse websites.urlscan.ioReport URImonitoring security policies like CSP and HPKP.report-uri.comCSP Evaluatorallows developers and security experts to check if a Content Security Policy.csp-evaluator.withgoogle.comUseless CSPpublic list about CSP in some big players (might make them care a bit more).uselesscsp.comWhy No HTTPS?top 100 websites by Alexa rank not automatically redirecting insecure requests.whynohttps.comTLS Cipher Suite Searchcipher suite search engine.ciphersuite.infocipherli.ststrong ciphers for Apache, Nginx, Lighttpd, and more.github.comoffline?dhtoolpublic Diffie-Hellman parameter service/tool.2ton.com.aubadssl.commemorable site for testing clients against bad SSL configs.badssl.comtlsfun.deregistered for various tests regarding the TLS/SSL protocol.tlsfun.deCAA Record Helpergenerate a CAA policy.sslmate.comCommon CA Databaserepository of information about CAs, and their root and intermediate certificates.ccadb.orgCERTSTREAMreal-time certificate transparency log update stream.certstream.calidog.iocrt.shdiscovers certificates by continually monitoring all of the publicly known CT.crt.shHardenizedeploy the security standards.hardenize.comCipher suite compatibilitytest TLS cipher suite compatibility.cryptcheck.frurlvoidthis service helps you detect potentially malicious websites.urlvoid.comsecurity.txta proposed standard (generator) which allows websites to define security policies.securitytxt.orgssl-config-generatorhelp you follow the Mozilla Server Side TLS configuration guidelines.github.comTLScanpure python, SSL/TLS protocol and cipher scanner/enumerator.github.com
#HTTP Headers & Web Linters
#DNS
ViewDNSone source for free DNS related tools and information.viewdns.infoDNSLookupis an advanced DNS lookup tool.dnslookup.orgDNSlyticsonline DNS investigation tool.dnslytics.comDNS Spymonitor, validate and verify your DNS configurations.dnsspy.ioZonemasterhelps you to control how your DNS works.zonemaster.iis.seLeaf DNScomprehensive DNS tester.leafdns.comFind subdomains onlinefind subdomains for security assessment penetration test.findsubdomains.comDNSdumpsterdns recon & research, find & lookup dns records.dnsdumpster.comDNS Table onlinesearch for DNS records by domain, IP, CIDR, ISP.dnstable.comintoDNSDNS and mail server health checker.intodns.comDNS Bajajcheck the delegation of your domain.zonecut.netBuddyDNS Delegation LABcheck, trace and visualize delegation of your domain.buddyns.comdnssec-debuggerDS or DNSKEY records validator.dnssec-debugger.verisignlabs.comPTRarchive.comthis site is responsible for the safekeeping of historical reverse DNS records.ptrarchive.comxip.iowildcard DNS for everyone.xip.ionip.iodead simple wildcard DNS for any IP Address.nip.iodnslookup (ceipam)one of the best DNS propagation checker (and not only).ceipam.euWhat's My DNSDNS propagation checking tool.whatsmydns.comDNSGrepquickly searching large DNS datasets.blog.erbbysam.com
smtp-tls-checkercheck an email domain for SMTP TLS support.luxsci.comMX Toolboxall of your MX record, DNS, blacklist and SMTP diagnostics in one integrated tool.mxtoolbox.comSecure Emailcomplete email test tools for email technicians.checktls.comblacklistalertchecks to see if your domain is on a Real Time Spam Blacklist.blacklistalert.orgMultiRBLcomplete IP check for sending Mailservers.multirbl.valli.orgDKIM SPF & Spam Assassin Validatorchecks mail authentication and scores messages with Spam Assassin.dkimvalidator.com
#Encoders/Decoders and Regex testing
URL Encode/Decodetool from above to either encode or decode a string of text.url-encode-decode.comUncoderthe online translator for search queries on log data.uncoder.ioRegex101online regex tester and debugger: PHP, PCRE, Python, Golang and JavaScript.regex101.comRegExronline tool to learn, build, & test Regular Expressions (RegEx / RegExp).regexr.comRegEx Testingonline regex testing tool.regextester.comRegEx Palonline regex testing tool + other tools.regexpal.comThe Cyber Swiss Army Knifea web app for encryption, encoding, compression and data analysis.gchq.github.io
#Net-tools
Netcraftdetailed report about the site, helping you to make informed choices about their integrity.toolbar.netcraft.comoffline?RIPE NCC Atlasa global, open, distributed Internet measurement platform.atlas.ripe.netRobtexuses various sources to gather public information about IP numbers, domain names, host names, etc.robtex.comSecurity TrailsAPIs for Security Companies, Researchers and Teams.securitytrails.comOnline Curlcurl test, analyze HTTP Response Headers.tools.keycdn.comOnline Tools for DevelopersHTTP API tools, testers, encoders, converters, formatters, and other tools.extendsclass.comPing.euonline Ping, Traceroute, DNS lookup, WHOIS and others.ping.euNetwork-Toolsnetwork tools for webmasters, IT technicians & geeks.network-tools.comBGPviewsearch for any ASN, IP, Prefix or Resource name.bgpview.ioIs BGP safe yet?check BGP (RPKI) security of ISPs and other major Internet players.isbgpsafeyet.comRiseupprovides online communication tools for people and groups working on liberatory social change.riseup.netVirusTotalanalyze suspicious files and URLs to detect types of malware.virustotal.com
#Privacy
#Code parsers/playgrounds
ShellCheckfinds bugs in your shell scripts.shellcheck.netexplainshellget interactive help texts for shell commands.explainshell.comjsbinlive pastebin for HTML, CSS & JavaScript, and more.jsbin.comCodeSandboxonline code editor for web application development.codesandbox.ioPHP Sandboxtest your PHP code with this code tester.sandbox.onlinephpfunctions.comRepl.itan instant IDE to learn, build, collaborate, and host all in one place.repl.itvclFiddleis an online tool for experimenting with the Varnish Cache VCL.vclfiddle.netHaskell Dockerfile Lintera smarter Dockerfile linter that helps you build best practice Docker images.github.com
#Performance
GTmetrixanalyze your site’s speed and make it faster.gtmetrix.comSucuri loadtimetestertest here the
performance of any of your sites from across the globe.performance.sucuri.netPingdom Toolsanalyze your site’s speed around the world.tools.pingdom.comPingMe.iorun website latency tests across multiple geographic regions.pingme.ioPageSpeed Insightsanalyze your site’s speed and make it faster.developers.google.comweb.devhelps developers like you learn and apply the web's modern capabilities to your own sites and apps.web.devLighthouseautomated auditing, performance metrics, and best practices for the web.github.com
#Mass scanners (search engines)
Censysplatform that helps information security practitioners discover, monitor, and analyze devices.censys.ioShodanthe world's first search engine for Internet-connected devices.shodan.ioShodan 2000this tool looks for randomly generated data from Shodan.2000.shodan.ioGreyNoisemass scanner such as Shodan and Censys.viz.greynoise.ioZoomEyesearch engine for cyberspace that lets the user find specific network components.zoomeye.orgnetographtools to monitor and understand deep structure of the web.netograph.ioFOFAis a cyberspace search engine.fofa.soonypheis a search engine for open-source and cyber threat intelligence data collected.onyphe.ioIntelligenceXis a search engine and data archive.intelx.iobinaryedgeit scan the entire internet space and create real-time threat intelligence streams and reports.app.binaryedge.ioSpyseInternet assets registry: networks, threats, web objects, etc.spyse.comwigleis a submission-based catalog of wireless networks. All the networks. Found by Everyone.wigle.netPublicWWWfind any alphanumeric snippet, signature or keyword in the web pages HTML, JS and CSS code.publicwww.comIntelTechniquesthis repository contains hundreds of online search utilities.inteltechniques.comhunterlets you find email addresses in seconds and connect with the people that matter for your business.hunter.ioGhostProject?search by full email address or username.ghostproject.frdatabreacheswas my email affected by data breach?databreaches.liveWe Leak Infoworld's fastest and largest data breach search engine.weleakinfo.comPulsedivescans of malicious URLs, IPs, and domains, including port scans and web requests.pulsedive.comBuckets by Grayhatwarfardatabase with public search for Open Amazon S3 Buckets and their contents.buckets.grayhatwarfare.comVigilante.pwthe breached database directory.vigilante.pwbuiltwithfind out what websites are built with.builtwith.comNerdyDatasearch the web's source code for technologies, across millions of sites.nerdydata.comzorexeyesearch for sites, images, apps, softwares & more.zorexeye.comMamont's open FTP Indexif a target has an open FTP site with accessible content it will be listed here.mmnt.netOSINT Frameworkfocused on gathering information from free tools or resources.osintframework.commaltiverseis a service oriented to cybersecurity analysts.maltiverse.comLeaked Sourceis a collaboration of data found online in the form of a lookup.leakedsource.ruWe Leak Infoto help everyday individuals secure their online life, avoiding getting hacked.search.weleakinfo.compiplis the place to find the person behind the email address, social username or phone number.pipl.comabuse.chis operated by a random swiss guy fighting malware for non-profit.abuse.chmalc0demalware search engine.malc0de.comCybercrime Trackermonitors and tracks various malware families that are used to perpetrate cyber crimes.cybercrime-tracker.netshhgitfind GitHub secrets in real time.github.comsearchcodehelping you find real world examples of functions, API's and libraries.searchcode.comInsecamthe world biggest directory of online surveillance security cameras.insecam.orgindex-ofcontains great stuff like: security, hacking, reverse engineering, cryptography, programming etc.index-of.esRapid7 Labs Open Datais a great resources of datasets from Project Sonar.opendata.rapid7.comCommon Response Headersthe largest database of HTTP response headers.webtechsurvey.comInQuest LabsInQuest Labs is an open, interactive, and API driven data portal for security researchers.labs.inquest.net
#Generators
thispersondoesnotexistgenerate fake faces in one click - endless possibilities.thispersondoesnotexist.comAI Generated Photos100.000 AI generated faces.generated.photosfakenamegeneratoryour randomly generated identity.fakenamegenerator.comIntigriti Redirectoropen redirect/SSRF payload generator.tools.intigriti.io
#Passwords
#CVE/Exploits databases
CVE Mitrelist of publicly known cybersecurity vulnerabilities.cve.mitre.orgCVE DetailsCVE security vulnerability advanced database.cvedetails.comExploit DBCVE compliant archive of public exploits and corresponding vulnerable software.exploit-db.com0day.todayexploits market provides you the possibility to buy/sell zero-day exploits.0day.todaysploitusthe exploit and tools database.sploitus.comcxsecurityfree vulnerability database.cxsecurity.comVulncode-DBis a database for vulnerabilities and their corresponding source code if available.vulncode-db.comcveapifree API for CVE data.cveapi.com
#Mobile apps scanners
#Private Search Engines
Startpagethe world's most private search engine.startpage.comsearXa privacy-respecting, hackable metasearch engine.searx.medarksearchthe 1st real Dark Web search engine.darksearch.ioQwantthe search engine that respects your privacy.qwant.comDuckDuckGothe search engine that doesn't track you.duckduckgo.comSwisscowsprivacy safe web searchswisscows.comDisconnectthe search engine that anonymizes your searches.search.disconnect.meMetaGerthe search engine that uses anonymous proxy and hidden Tor branches.metager.org
#Secure Webmail Providers
CounterMailonline email service, designed to provide maximum security and privacy.countermail.comMail2Toris a Tor Hidden Service that allows anyone to send and receive emails anonymously.mail2tor.comTutanotais the world's most secure email service and amazingly easy to use.tutanota.comProtonmailis the world's largest secure email service, developed by CERN and MIT scientists.protonmail.comStartmailprivate & encrypted email made easy.startmail.com
#Crypto
#PGP Keyservers
Systems/Services
#Operating Systems
Slackwarethe most "Unix-like" Linux distribution.slackware.comOpenBSDmulti-platform 4.4BSD-based UNIX-like operating system.openbsd.orgHardenedBSDHardenedBSD aims to implement innovative exploit mitigation and security solutions.hardenedbsd.orgKali LinuxLinux distribution used for Penetration Testing, Ethical Hacking and network security assessments.kali.orgParrot Security OScyber security GNU/Linux environment.parrotsec.orgBackbox Linuxpenetration test and security assessment oriented Ubuntu-based Linux distribution.backbox.orgBlackArchis an Arch Linux-based penetration testing distribution for penetration testers.blackarch.orgPentoois a security-focused livecd based on Gentoo.pentoo.chSecurity OnionLinux distro for intrusion detection, enterprise security monitoring, and log management.securityonion.netTailsis a live system that aims to preserve your privacy and anonymity.tails.boum.orgvedettaOpenBSD router boilerplate.github.comQubes OSis a security-oriented OS that uses Xen-based virtualization.qubes-os.org
#HTTP(s) Services
Varnish CacheHTTP accelerator designed for content-heavy dynamic web sites.varnish-cache.orgNginxopen source web and reverse proxy server that is similar to Apache, but very light weight.nginx.orgOpenRestyis a dynamic web platform based on NGINX and LuaJIT.openresty.orgTenginea distribution of Nginx with some advanced features.github.comCaddy Serveris an open source, HTTP/2-enabled web server with HTTPS by default.caddyserver.comHAProxythe reliable, high performance TCP/HTTP load balancer.haproxy.org
#DNS Services
#Other Services
#Security/hardening
Emerald Onionis a 501(c)(3) nonprofit organization and transit internet service provider (ISP).twitter.compi-holethe Pi-hole® is a DNS sinkhole that protects your devices from unwanted content.github.commaltrailmalicious traffic detection system.github.comsecurity_monkeymonitors AWS, GCP, OpenStack, and GitHub orgs for assets and their changes over time.github.comfirecrackersecure and fast microVMs for serverless computing.github.comstreisandsets up a new server running your choice of WireGuard, OpenSSH, OpenVPN, and more.github.com
Networks
#Tools
#Labs
#Other
Containers/Orchestration
#CLI Tools
#Web Tools
Mobya collaborative project for the container ecosystem to assemble container-based system.github.comTraefikopen source reverse proxy/load balancer provides easier integration with Docker and Let's encrypt.traefik.iokongThe Cloud-Native API Gateway.github.comranchercomplete container management platform.github.comportainermaking Docker management easy.github.comnginx-proxyautomated nginx proxy for Docker containers using docker-gen.github.combunkerized-nginxnginx docker image "secure by default".github.com
#Security
docker-bench-securitychecks for dozens of common best-practices around deploying Docker.github.comtrivyvulnerability scanner for containers, suitable for CI.github.comHarborcloud native registry project that stores, signs, and scans content.goharbor.ioHoudinihundreds of offensive and useful docker images for network intrusion.houdini.secsi.io
#Manuals/Tutorials/Best Practices
docker-cheat-sheeta quick reference cheat sheet on Docker.github.comawesome-dockera curated list of Docker resources and projects.github.comdocker_practicelearn and understand Docker technologies, with real DevOps practice!github.comlabsis a collection of tutorials for learning how to use Docker with various tools.github.comdockerfilesvarious Dockerfiles I use on the desktop and on servers.github.comkubernetes-the-hard-waybootstrap Kubernetes the hard way on Google Cloud Platform. No scripts.github.comkubernetes-the-easy-waybootstrap Kubernetes the easy way on Google Cloud Platform. No scripts.github.comcheatsheet-kubernetes-A4Kubernetes CheatSheets in A4.github.comk8s-securitykubernetes security notes and best practices.github.comkubernetes-production-best-practiceschecklists with best-practices for production-ready Kubernetes.learnk8s.iokubernetes-production-best-practiceskubernetes security - best practice guide.github.comkubernetes-failure-storiesis a compilation of public failure/horror stories related to Kubernetes.github.com
Manuals/Howtos/Tutorials
#Shell/Command line
pure-bash-bibleis a collection of pure bash alternatives to external processes.github.compure-sh-bibleis a collection of pure POSIX sh alternatives to external processes.github.combash-guideis a guide to learn bash.github.combash-handbookfor those who wanna learn Bash.github.comThe Bash Hackers Wikihold documentation of any kind about GNU Bash.wiki.bash-hackers.orgShell & Utilitiesdescribes the commands offered to application programs by POSIX-conformant systems.pubs.opengroup.orgthe-art-of-command-linemaster the command line, in one page.github.comShell Style Guidea shell style guide for Google-originated open-source projects.google.github.io
#Text Editors
#Python
#Sed & Awk & Other
#\*nix & Network
nixCraftlinux and unix tutorials for new and seasoned sysadmin.cyberciti.bizTecMintthe ideal Linux blog for Sysadmins & Geeks.tecmint.comOmnisecufree Networking, System Administration and Security tutorials.omnisecu.comlinux-cheatLinux tutorials and cheatsheets. Minimal examples. Mostly user-land CLI utilities.github.comlinuxupskillchallengelearn the skills required to sysadmin.github.comUnix ToolboxUnix/Linux/BSD commands and tasks which are useful for IT work or for advanced users.cb.vuLinux Kernel Teachingis a collection of lectures and labs Linux kernel topics.linux-kernel-labs.github.iohtop explainedexplanation of everything you can see in htop/top on Linux.peteris.rocksLinux Guide and Hintstutorials on system administration in Fedora and CentOS.linuxguideandhints.comstrace-little-booka little book which introduces strace.github.comlinux-tracing-workshopexamples and hands-on labs for Linux tracing tools workshops.github.comhttp2-explaineda detailed document explaining and documenting HTTP/2.github.comhttp3-explaineda document describing the HTTP/3 and QUIC protocols.github.comHTTP/2 in Actionan excellent introduction to the new HTTP/2 standard.manning.comLet's code a TCP/IP stackgreat stuff to learn network and system programming at a deeper level.saminiir.comNginx Admin's Handbookhow to improve NGINX performance, security and other important things.github.comnginxconfig.ioNGINX config generator on steroids.github.comopenssh guidelineis to help operational teams with the configuration of OpenSSH server and client.infosec.mozilla.orgSSH Handshake Explainedis a relatively brief description of the SSH handshake.gravitational.comISC's Knowledgebaseyou'll find some general information about BIND 9, ISC DHCP, and Kea DHCP.kb.isc.orgPacketLife.neta place to record notes while studying for Cisco's CCNP certification.packetlife.net
#Microsoft
#Large-scale systems
#System hardening
CIS Benchmarkssecure configuration settings for over 100 technologies, available as a free PDF.cisecurity.orgSecurity Harden CentOS 7this walks you through the steps required to security harden CentOS.highon.coffeeCentOS 7 Server Hardening Guidegreat guide for hardening CentOS; familiar with OpenSCAP.lisenet.comawesome-security-hardeningis a collection of security hardening guides, tools and other resources.github.comThe Practical Linux Hardening Guideprovides a high-level overview of hardening GNU/Linux systems.github.comLinux Hardening Guidehow to harden Linux as much as possible for security and privacy.madaidans-insecurities.github.io
#Security & Privacy
Hacking ArticlesLRaj Chandel's Security & Hacking Blog.hackingarticles.inAWS security toolsmake your AWS cloud environment more secure.github.comRawsec's CyberSecurity Inventoryan inventory of tools and resources about CyberSecurity.inventory.rawsec.mlThe Illustrated TLS Connectionevery byte of a TLS connection explained and reproduced.tls.ulfheim.netSSL ResearchSSL and TLS Deployment Best Practices by SSL Labs.github.comSELinux Gamelearn SELinux by doing. Solve Puzzles, show skillz.selinuxgame.orgCertificates and PKIeverything you should know about certificates and PKI but are too afraid to ask.smallstep.comThe Art of Subdomain Enumerationa reference for subdomain enumeration techniques.appsecco.comQuitting Googlethe comprehensive guide to quitting Google.lifehacker.com
#Web Apps
OWASPworldwide not-for-profit charitable organization focused on improving the security of software.owasp.orgOWASP ASVS 3.0.1OWASP Application Security Verification Standard Project.owasp.orgOWASP ASVS 3.0.1 Web Appsimple web app that helps developers understand the ASVS requirements.github.comOWASP ASVS 4.0is a list of application security requirements or tests.github.comOWASP Testing Guide v4includes a "best practice" penetration testing framework.owasp.orgOWASP Dev Guidethis is the development version of the OWASP Developer Guide.github.comOWASP WSTGis a comprehensive open source guide to testing the security of web apps.github.comOWASP API Security Projectfocuses specifically on the top ten vulnerabilities in API security.owasp.orgMozilla Web Securityhelp operational teams with creating secure web applications.infosec.mozilla.orgsecurity-bulletinssecurity bulletins that relate to Netflix Open Source.github.comAPI-Security-Checklistsecurity countermeasures when designing, testing, and releasing your API.github.comEnable CORSenable cross-origin resource sharing.enable-cors.orgApplication Security Wikiis an initiative to provide all application security related resources at one place.appsecwiki.comWeird Proxiesreverse proxy related attacks; it is a result of analysis of various proxies.github.comWebshellsgreat series about malicious payloads.dfir.itPractical Web Cache Poisoningshow you how to compromise websites by using esoteric web features.portswigger.netHidden directories and filesas a source of sensitive information about web application.github.comExplosive bloggreat blog about cybersec and pentests.bo0om.ruSecurity Cookiesthis paper will take a close look at cookie security.netsparker.comAPISecurityBestPracticeshelp you keep secrets (API keys, db credentials, certificates) out of source code.github.com
#All-in-one
LZone Cheat Sheetsall cheat sheets.lzone.deDan’s Cheat Sheets’smassive cheat sheets documentation.github.comRico's cheatsheetsthis is a modest collection of cheatsheets.devhints.ioDevDocs APIcombines multiple API documentations in a fast, organized, and searchable interface.devdocs.iocheat.shthe only cheat sheet you need.cheat.shgnulinux.gurucollection of cheat sheets about bash, vim and networking.gnulinux.guruWeb Skillsvisual overview of useful skills to learn as a web developer.andreasbm.github.io
#Ebooks
#Other
CTF Series : Vulnerable Machinesthe steps below could be followed to find vulnerabilities and exploits.bitvijays.github.io50M_CTF_Writeup$50 million CTF from Hackerone - writeup.github.comctf-tasksan archive of low-level CTF challenges developed over the years.github.comHow to start RE/malware analysis?collection of some hints and useful links for the beginners.hshrzd.wordpress.comThe C10K problemit's time for web servers to handle ten thousand clients simultaneously, don't you think?kegel.comHow 1500 bytes became the MTU of the internetgreat story about the Maximum Transmission Unit.blog.benjojo.co.ukpoor man's profilerlike dtrace's don't really provide methods to see what programs are blocking on.poormansprofiler.orgHTTPS on Stack Overflowthis is the story of a long journey regarding the implementation of SSL.nickcraver.comJulia's Drawingssome drawings about programming and unix world, zines about systems & debugging tools.drawings.jvns.caHash collisionsthis great repository is focused on hash collisions exploitation.github.comsha256-animationanimation of the SHA-256 hash function in your terminal.github.comsha256algorithmsha256 algorithm explained online step by step visually.sha256algorithm.comBGP Meets Catafter 3072 hours of manipulating BGP, Job Snijders has succeeded in drawing a Nyancat.labs.ripe.netbgp-battleshipsplaying battleships over BGP.github.comWhat happens when...you type google.com into your browser and press enter?github.comhow-web-worksbased on the 'What happens when...' repository.github.comHTTPS in the real worldgreat tutorial explain how HTTPS works in the real world.robertheaton.comGitlab and NFS bughow we spent two weeks hunting an NFS bug in the Linux kernel.about.gitlab.comGitlab melts downpostmortem on the database outage of January 31 2017 with the lessons we learned.about.gitlab.comHow To Become A Hackerif you want to be a hacker, keep reading.catb.orgOperation Costs in CPUshould help to estimate costs of certain operations in CPU clocks.ithare.comLet's Build a Simple Databasewriting a sqlite clone from scratch in C.cstack.github.iosimple-computergreat resource to understand how computers work under the hood.djhworld.github.ioThe story of "Have I been pwned?"working with 154 million records on Azure Table Storage.troyhunt.comTOP500 Supercomputersshows the 500 most powerful commercially available computer systems.top500.orgHow to build a 8 GPU password crackerhours of frustration like desktop components do.shellntel.comCERN Data Centre3D visualizations of the CERN computing environments (and more).home.cernHow fucked is my databaseevaluate how fucked your database is with this handy website.howfuckedismydatabase.comLinux Troubleshooting 101 , 2016 Editioneverything is a DNS Problem...krisbuytaert.beFive Whysyou know what the problem is, but you cannot solve it?open.buffer.comMaersk, me & notPetyahow did ransomware successfully hijack hundreds of domain controllers?gvnshtn.comhowhttps.workshow HTTPS works ...in a comic!howhttps.workshowdns.worksa fun and colorful explanation of how DNS works.howdns.worksPOSTGRESQLCO.NFyour postgresql.conf documentation and recommendations.postgresqlco.nf
Inspiring Lists
#SysOps/DevOps
Awesome Sysadminamazingly awesome open source sysadmin resources.github.comAwesome Shellawesome command-line frameworks, toolkits, guides and gizmos.github.comCommand-line-text-processingfinding text to search and replace, sorting to beautifying, and more.github.comAwesome Pcaptoolscollection of tools developed by other researchers to process network traces.github.comawesome-ebpfa curated list of awesome projects related to eBPF.github.comLinux Network Performancewhere some of the network sysctl variables fit into the Linux/Kernel network flow.github.comAwesome Postgreslist of awesome PostgreSQL software, libraries, tools and resources.github.comquick-SQL-cheatsheeta quick reminder of all SQL queries and examples on how to use them.github.comAwesome-Selfhostedlist of Free Software network services and web applications which can be hosted locally.github.comList of applicationshuge list of apps sorted by category, as a reference for those looking for packages.wiki.archlinux.orgCS-Interview-Knowledge-Mapbuild the best interview map.github.comDevOps-GuideDevOps Guide from basic to advanced with Interview Questions and Notes.github.comFreeBSD Journalit is a great list of periodical magazines about FreeBSD and other important things.issue.freebsdfoundation.orgdevops-interview-questionscontains interview questions on various DevOps and SRE related topics.github.com
#Developers
Web Developer Roadmaproadmaps, articles and resources to help you choose your path, learn and improve.github.comFront-End-Checklistthe perfect Front-End Checklist for modern websites and meticulous developers.github.comFront-End-Performance-ChecklistFront-End Performance Checklist that runs faster than the others.github.comPython's Magic Methodswhat are magic methods? They're everything in object-oriented Python.rszalski.github.iowtfpythona collection of surprising Python snippets and lesser-known features.github.comjs-dev-readsa list of books and articles for the discerning web developer to read.github.comCommit messages guidea guide to understand the importance of commit messages.github.com
#Security/Pentesting
Awesome Web Securitya curated list of Web Security materials and resources.github.comawesome-cyber-skillsa curated list of hacking environments where you can train your cyber skills.github.comawesome-devsecopsan authoritative list of awesome devsecops tools.github.comawesome-osintis a curated list of amazingly awesome OSINT.github.comHolyTipstips and tutorials on Bug Bounty Hunting and Web App Security.github.comawesome-threat-intelligencea curated list of Awesome Threat Intelligence resources.github.comRed-Teaming-Toolkita collection of open source and commercial tools that aid in red team operations.github.comawesome-burp-extensionsa curated list of amazingly awesome Burp Extensions.github.comFree Security eBookslist of a Free Security and Hacking eBooks.github.comHacking-Security-Ebookstop 100 Hacking & Security E-Books.github.comprivacy-respectingcurated list of privacy respecting services and software.github.comreverse-engineeringlist of awesome reverse engineering resources.github.comlinux-re-101a collection of resources for linux reverse engineering.github.comreverseengineering-reading-lista list of Reverse Engineering articles, books, and papers.github.comAwesome-WAFa curated list of awesome web-app firewall (WAF) stuff.github.comawesome-shodan-queriesinteresting, funny, and depressing search queries to plug into shodan.io.github.comRobotsDisalloweda curated list of the most common and most interesting robots.txt disallowed directories.github.comHackingNeuralNetworksis a small course on exploiting and defending neural networks.github.comwildcard-certificateswhy you probably shouldn't use a wildcard certificate.gist.github.comDon't use VPN serviceswhich is what every third-party "VPN provider" does.gist.github.comawesome-yaraa curated list of awesome YARA rules, tools, and people.github.commacOS-Security-and-Privacy-Guideguide to securing and improving privacy on macOS.github.commacos_securitymacOS Security Compliance Project.github.comawesome-sec-talksis a collected list of awesome security talks.github.comMovies for Hackerslist of movies every hacker & cyberpunk must watch.github.comCryptography_1materials used whilst taking Prof. Dan Boneh Stanford Crypto course.github.comCryptonlibrary to learn and practice Offensive and Defensive Cryptography.github.com
#Other
Cheatographyover 3,000 free cheat sheets, revision aids and quick references.cheatography.comawesome-static-analysisstatic analysis tools for all programming languages.github.comcomputer-sciencepath to a free self-taught education in Computer Science.github.compost-mortemsis a collection of postmortems (config errors, hardware failures, and more).github.combuild-your-own-xbuild your own (insert technology here).github.comProject-Based-Tutorials-in-Cis a curated list of project-based tutorials in C.github.comThe-Documentation-Compendiumvarious README templates & tips on writing high-quality documentation.github.comawesome-python-applicationsfree software that works great, and also happens to be open-source Python.github.comawesome-public-datasetsa topic-centric list of HQ open datasets.github.commachine-learning-algorithmsa curated list of all machine learning algorithms and concepts.github.com
Blogs/Podcasts/Videos
#SysOps/DevOps
#Developers
#Geeky Persons
Brendan Gregg's Blogis an industry expert in computing performance and cloud computing.brendangregg.comGynvael "GynDream" Coldwindis a IT security engineer at Google.gynvael.coldwind.plMichał "lcamtuf" Zalewskiwhite hat hacker, computer security expert.lcamtuf.coredump.cxMattias Geniardeveloper, sysadmin, blogger, podcaster and public speaker.ma.ttias.beNick Craversoftware developer and systems administrator for Stack Exchange.nickcraver.comScott Helmesecurity researcher, speaker and founder of securityheaders.com and report-uri.com.scotthelme.co.ukBrian KrebsThe Washington Post and now an Independent investigative journalist.krebsonsecurity.comBruce Schneieris an internationally renowned security technologist, called a "security guru".schneier.comChrissy Morganadvocate of practical learning, Chrissy also takes part in bug bounty programs.chrissymorgan.co.ukAndy Gillis a hacker at heart who works as a senior penetration tester.blog.zsec.ukDaniel Miesslercybersecurity expert and writer.danielmiessler.comSamy Kamkaris an American privacy and security researcher, computer hacker.samy.plJavvad Malikis a security advocate at AlienVault, a blogger event speaker and industry commentator.j4vv4d.comGraham Cluleypublic speaker and independent computer security analyst.grahamcluley.comKacper Szurekdetection engineer at ESET.security.szurek.plTroy Huntweb security expert known for public education and outreach on security topics.troyhunt.comraymii.orgsysadmin specializing in building high availability cloud environments.raymii.orgRobert PenzIT security expert.robert.penz.name
#Geeky Blogs
Linux Auditthe Linux security blog about auditing, hardening and compliance by Michael Boelen.linux-audit.comLinux Security Experttrainings, howtos, checklists, security tools, and more.linuxsecurity.expertThe Grymoirecollection of useful incantations for wizards, be you computer wizards, magicians, or whatever.grymoire.comSecjuiceis the only non-profit, independent and volunteer led publication in the information security space.secjuice.comDeciphersecurity news that informs and inspires.duo.com
#Geeky Vendor Blogs
Tenable Podcastconversations and interviews related to Cyber Exposure, and more.tenable.comSophosthreat news room, giving you news, opinion, advice and research on computer security issues.nakedsecurity.sophos.comTripwire State of Securityblog featuring the latest news, trends and insights on current security issues.tripwire.comMalwarebytes Labs Blogsecurity blog aims to provide insider news about cybersecurity.blog.malwarebytes.comTrustedSeclatest news, and trends about cybersecurity.trustedsec.comPortSwigger Web Security Blogabout web app security vulns and top tips from our team of web security.portswigger.netAT&T Cybersecurity blognews on emerging threats and practical advice to simplify threat detection.alienvault.comThycoticwhere CISOs and IT Admins come to learn about industry trends, IT security, and more.thycotic.com
#Geeky Cybersecurity Podcasts
Risky Businessis a weekly information security podcast featuring news and in-depth interviews.risky.bizCyber, by Motherboardstories, and focus on the ideas about cybersecurity.vice.comTenable Podcastconversations and interviews related to Cyber Exposure, and more.tenable.comCybercrime Investigationspodcast by Geoff White about cybercrimes.podcasts.apple.comThe many hats clubfeaturing stories from a wide range of Infosec people (Whitehat, Greyhat and Blackhat).themanyhats.clubDarknet Diariestrue stories from the dark side of the Internet.darknetdiaries.comOSINTCurious Webcastsis the investigative curiosity that helps people be successful in OSINT.youtube.comSecurity Weeklythe latest information security and hacking news.youtube.com
#Geeky Cybersecurity Video Blogs
rev3rse securityoffensive, binary exploitation, web app security, hardening, red team, blue team.youtube.comLiveOverflowa lot more advanced topics than what is typically offered in paid online courses - but for free.youtube.comJ4vv4Dthe important information regarding our internet security.youtube.comCyberTalkstalks, interviews, and article about cybersecurity.cybertalks.co.uk
#Best Personal Twitter Accounts
@blackroomseca white-hat hacker/pentester. Intergalactic Minesweeper Champion 1990.twitter.com@MarcoCiappelliCo-Founder @ITSPmagazine, at the intersection of IT security and society.twitter.com@binitamshahLinux Evangelist. Malwares. Kernel Dev. Security Enthusiast.twitter.com@joe_carsonan InfoSec Professional and Tech Geek.twitter.com@mikkoCRO at F-Secure, Reverse Engineer, TED Speaker, Supervillain.twitter.com@esrtweetoften referred to as ESR, is an American software developer, and open-source software advocate.twitter.com@gynvaelsecurity researcher/programmer, @DragonSectorCTF founder/player, technical streamer.twitter.com@x0rzSecurity Researcher & Cyber Observer.twitter.com@hasherezadeprogrammer, malware analyst. Author of PEbear, PEsieve, libPeConv.twitter.com@TinkerSectinkerer, cypherpunk, hacker.twitter.com@alisaesageindependent hacker and researcher.twitter.com@SwiftOnSecuritysystems security, industrial safety, sysadmin, author of decentsecurity.com.twitter.com@dakamiis one of just seven people with the authority to restore the DNS root keys.twitter.com@samykamkaris a famous "grey hat" hacker, security researcher, creator of the MySpace "Samy" worm.twitter.com@securityweeklyfounder & CTO of Security Weekly podcast network.twitter.com@jack_daniel@SecurityBSides co-founder.twitter.com@thegrugqSecurity Researcher.twitter.com@matthew_d_greena cryptographer and professor at Johns Hopkins University.twitter.com
#Best Commercial Twitter Accounts
@haveibeenpwnedcheck if you have an account that has been compromised in a data breach.twitter.com@bugcrowdtrusted by more of the Fortune 500 than any other crowdsourced security platform.twitter.com@Malwarebytesmost trusted security company. Unmatched threat visibility.twitter.com@sansforensicsthe world's leading Digital Forensics and Incident Response provider.twitter.com@attcyberAT&T Cybersecurity’s Edge-to-Edge technologies provide threat intelligence, and more.twitter.com@TheManyHatsCluban information security focused podcast and group of individuals from all walks of life.twitter.com@hedgehogsecHedgehog Cyber. Gibraltar and Manchester's top boutique information security firm.twitter.com@NCSCthe National Cyber Security Centre. Helping to make the UK the safest place to live and work online.twitter.com@SynacktivIT security experts.twitter.com
#A piece of history
#Other
Hacking/Penetration Testing
#Pentesters arsenal tools
Sandcat Browsera penetration-oriented browser with plenty of advanced functionality already built in.syhunt.comMetasploittool and framework for pentesting system, web and many more.metasploit.comBurp Suitetool for testing web app security, intercepting proxy to replay, inject, scan and fuzz.portswigger.netOWASP Zed Attack Proxyintercepting proxy to replay, inject, scan and fuzz HTTP requests.owasp.orgw3afis a Web Application Attack and Audit Framework.w3af.orgmitmproxyan interactive TLS-capable intercepting HTTP proxy for penetration testers.mitmproxy.orgNikto2web server scanner which performs comprehensive tests against web servers for multiple items.cirt.netsqlmaptool that automates the process of detecting and exploiting SQL injection flaws.sqlmap.orgRecon-ngis a full-featured Web Reconnaissance framework written in Python.github.comAutoReconis a network reconnaissance tool which performs automated enumeration of services.github.comFaradayan Integrated Multiuser Pentest Environment.faradaysec.comPhotonincredibly fast crawler designed for OSINT.github.comXSStrikemost advanced XSS detection suite.github.comSn1perautomated pentest framework for offensive security experts.github.comvulsis an agent-less vulnerability scanner for Linux, FreeBSD, and other.github.comtsunamiis a general purpose network security scanner with an extensible plugin system.github.comaquatonea tool for domain flyovers.github.comBillCipherinformation gathering tool for a website or IP address.github.comWhatWafdetect and bypass web application firewalls and protection systems.github.comCorsyCORS misconfiguration scanner.github.comRaccoonis a high performance offensive security tool for reconnaissance and vulnerability scanning.github.comdirhuntfind web directories without bruteforce.github.comJohn The Ripperis a fast password cracker, currently available for many flavors of Unix, Windows, and other.openwall.comhashcatworld's fastest and most advanced password recovery utility.hashcat.netp0fis a tool to identify the players behind any incidental TCP/IP communications.lcamtuf.coredump.cxssh_scana prototype SSH configuration and policy scanner.github.comLeakLookerfind open databases - powered by Binaryedge.iogithub.comexploitdbsearchable archive from The Exploit Database.github.comgetsploitis a command line utility for searching and downloading exploits.github.comctf-toolssome setup scripts for security research tools.github.compwntoolsCTF framework and exploit development library.github.comsecurity-toolscollection of small security tools created mostly in Python. CTFs, pentests and so on.github.compentestpackageis a package of Pentest scripts.github.compython-pentest-toolspython tools for penetration testers.github.comfuzzdbdictionary of attack patterns and primitives for black-box application fault injection.github.comAFLis a free software fuzzer maintained by Google.github.comAFL++is AFL with community patches.github.comsyzkalleris an unsupervised, coverage-guided kernel fuzzer.github.compwndbgexploit development and reverse engineering with GDB made easy.github.comGDB PEDAPython Exploit Development Assistance for GDB.github.comIDAmulti-processor disassembler and debugger useful for reverse engineering malware.hex-rays.comradare2framework for reverse-engineering and analyzing binaries.github.comroutersploitexploitation framework for embedded devices.github.comGhidrais a software reverse engineering (SRE) framework.github.comCutteris an SRE platform integrating Ghidra's decompiler.cutter.reVulnreportopen-source pentesting management and automation platform by Salesforce Product Security.github.comMentalistis a graphical tool for custom wordlist generation.github.comarcherysecvulnerability assessment and management helps to perform scans and manage vulnerabilities.github.comOsmedeusfully automated offensive security tool for reconnaissance and vulnerability scanning.github.combeefthe browser exploitation framework project.github.comAutoSploitautomated mass exploiter.github.comSUDO_KILLERis a tool to identify and exploit sudo rules' misconfigurations and vulnerabilities.github.comyarathe pattern matching swiss knife.github.commimikatza little tool to play with Windows security.github.comsherlockhunt down social media accounts by username across social networks.github.comOWASP Threat Dragonis a tool used to create threat model diagrams and to record possible threats.owasp.org
#Pentests bookmarks collection
PTESthe penetration testing execution standard.pentest-standard.orgPentests MindMapamazing mind map with vulnerable apps and systems.amanhardikar.comWebApps Security Tests MindMapincredible mind map for WebApps security tests.amanhardikar.comBrute XSSmaster the art of Cross Site Scripting.brutelogic.com.brXSS cheat sheetcontains many vectors that can help you bypass WAFs and filters.portswigger.netOffensive Security Bookmarkssecurity bookmarks collection, all things that author need to pass OSCP.jivoi.github.ioAwesome Pentest Cheat Sheetscollection of the cheat sheets useful for pentesting.github.comAwesome Hacking by HackWithGithubawesome lists for hackers, pentesters and security researchers.github.comAwesome Hacking by carpedm20a curated list of awesome hacking tutorials, tools and resources.github.comAwesome Hacking Resourcescollection of hacking/penetration testing resources to make you better.github.comAwesome Pentestcollection of awesome penetration testing resources, tools and other shiny things.github.comAwesome-Hacking-Toolsis a curated list of awesome Hacking Tools.github.comHacking Cheat Sheetauthor hacking and pentesting notes.github.comblackhat-arsenal-toolsofficial Black Hat arsenal security tools repository.github.comPenetration Testing and WebApp Cheat Sheetsthe complete list of Infosec related cheat sheets.peerlyst.comCyber Security Resourcesincludes thousands of cybersecurity-related references and resources.github.comPentest Bookmarksthere are a LOT of pentesting blogs.github.comCheatsheet-GodPenetration Testing Reference Bank - OSCP/PTP & PTX Cheatsheet.github.comThreatHunter-Playbookto aid the development of techniques and hypothesis for hunting campaigns.github.comBeginner-Network-Pentestingnotes for beginner network pentesting course.github.comOSCPRepois a list of resources that author have been gathering in preparation for the OSCP.github.comPayloadsAllTheThingsa list of useful payloads and bypass for Web Application Security and Pentest/CTF.github.compayloadsgit all the Payloads! A collection of web attack payloads.github.comcommand-injection-payload-listcommand injection payload list.github.comAwesome Shodan Search Queriesgreat search queries to plug into Shodan.github.comAwesomeXSSis a collection of Awesome XSS resources.github.comphp-webshellscommon php webshells.github.comPentesting Tools Cheat Sheeta quick reference high level overview for typical penetration testing.highon.coffeeOWASP Cheat Sheet Seriesis a collection of high value information on specific application security topics.cheatsheetseries.owasp.orgOWASP dependency-checkis an open source solution the OWASP Top 10 2013 entry.jeremylong.github.ioOWASP ProActive ControlsOWASP Top 10 Proactive Controls 2018.owasp.orgPENTESTING-BIBLEhacking & penetration testing & red team & cyber security resources.github.compentest-wikiis a free online security knowledge library for pentesters/researchers.github.comDEF CON Media Servergreat stuff from DEFCON.media.defcon.orgAwesome Malware Analysisa curated list of awesome malware analysis tools and resources.github.comSQL Injection Cheat Sheetdetailed technical stuff about the many different variants of the SQL Injection.netsparker.comEntersoft Knowledge Basegreat and detailed reference about vulnerabilities.kb.entersoft.co.inHTML5 Security Cheatsheeta collection of HTML5 related XSS attack vectors.html5sec.orgXSS String Encoderfor generating XSS code to check your input validation filters against XSS.evuln.comGTFOBinslist of Unix binaries that can be exploited by an attacker to bypass local security restrictions.gtfobins.github.ioGuifre Ruiz Notescollection of security, system, network and pentest cheatsheets.guif.reSSRF Tipsa collection of SSRF Tips.blog.safebuff.comshell-storm repo CTFgreat archive of CTFs.shell-storm.orgctfCTF (Capture The Flag) writeups, code snippets, notes, scripts.github.comMy-CTF-Web-Challengescollection of CTF Web challenges.github.comMSTGThe Mobile Security Testing Guide (MSTG) is a comprehensive manual for mobile app security testing.github.comInternal-Pentest-Playbooknotes on the most common things for an Internal Network Penetration Test.github.comKeyHacksshows quick ways in which API keys leaked by a bug bounty program can be checked.github.comsecuritum/researchvarious Proof of Concepts of security research performed by Securitum.github.compublic-pentesting-reportsis a list of public pentest reports released by several consulting security groups.github.comawesome-bug-bountyis a comprehensive curated list of available Bug Bounty.github.combug-bounty-referenceis a list of bug bounty write-ups.github.comAwesome-Bugbounty-Writeupsis a curated list of bugbounty writeups.github.comBug bounty writeupslist of bug bounty writeups (2012-2020).pentester.landhackso.mea great journey into security.hackso.me
#Backdoors/exploits
#Wordlists and Weak passwords
Weakpassfor any kind of bruteforce find wordlists or unleash the power of them all at once!weakpass.comHashes.orgis a free online hash resolving service incorporating many unparalleled techniques.hashes.orgSecListscollection of multiple types of lists used during security assessments, collected in one place.github.comProbable-Wordlistssorted by probability originally created for password generation and testing.github.comskullsecurity passwordspassword dictionaries and leaked passwords repository.wiki.skullsecurity.orgPolish PREMIUM Dictionaryofficial dictionary created by the team on the forum bezpieka.org.* 1bezpieka.orgstatistically-likely-usernameswordlists for creating statistically likely username lists.github.com
#Bounty platforms
YesWeHackbug bounty platform with infosec jobs.yeswehack.comOpenbugbountyallows any security researcher reporting a vulnerability on any website.openbugbounty.orghackeroneglobal hacker community to surface the most relevant security issues.hackerone.combugcrowdcrowdsourced cybersecurity for the enterprise.bugcrowd.comCrowdshieldcrowdsourced security & bug bounty management.crowdshield.comSynackcrowdsourced security & bug bounty programs, crowd security intelligence platform, and more.synack.comHacktrophybug bounty platform.hacktrophy.com
#Web Training Apps (local installation)
OWASP-VWADcomprehensive and well maintained registry of all known vulnerable web applications.owasp.orgDVWAPHP/MySQL web application that is damn vulnerable.dvwa.co.ukmetasploitable2vulnerable web application amongst security researchers.metasploit.help.rapid7.commetasploitable3is a VM that is built from the ground up with a large amount of security vulnerabilities.github.comDSVWis a deliberately vulnerable web application written in under 100 lines of code.github.comOWASP Mutillidae IIfree, open source, deliberately vulnerable web-application.sourceforge.netOWASP Juice Shop Projectthe most bug-free vulnerable application in existence.owasp.orgOWASP Node js Goat ProjectOWASP Top 10 security risks apply to web apps developed using Node.js.owasp.orgjuicy-ctfrun Capture the Flags and Security Trainings with OWASP Juice Shop.github.comSecurityShepherdweb and mobile application security training platform.github.comSecurity Ninjasopen source application security training program.github.comhackazona modern vulnerable web app.github.comdvnadamn vulnerable NodeJS application.github.comdjango-DefectDojois an open-source application vulnerability correlation and security orchestration tool.github.comGoogle Gruyereweb application exploits and defenses.google-gruyere.appspot.comBodhiis a playground focused on learning the exploitation of client-side web vulnerabilities.github.comWebsploitsingle vm lab with the purpose of combining several vulnerable appliations in one environment.websploit.h4cker.orgvulhubpre-built Vulnerable Environments based on docker-compose.github.comCloudGoat 2the new & improved "Vulnerable by Design"
AWS deployment tool.rhinosecuritylabs.comsecDevLabsis a laboratory for learning secure web development in a practical manner.github.comCORS-vulnerable-Labsample vulnerable code and its exploit code.github.comRootTheBoxa Game of Hackers (CTF Scoreboard & Game Manager).github.comKONTRAapplication security training (OWASP Top Web & Api).application.security
#Labs (ethical hacking platforms/trainings/CTFs)
Offensive Securitytrue performance-based penetration testing training for over a decade.offensive-security.comHack The Boxonline platform allowing you to test your penetration testing skills.hackthebox.euHacking-Labonline ethical hacking, computer network and security challenge platform.hacking-lab.compwnable.krnon-commercial wargame site which provides various pwn challenges.pwnable.krPwnable.twis a wargame site for hackers to test and expand their binary exploiting skills.pwnable.twpicoCTFis a free computer security game targeted at middle and high school students.picoctf.comCTFlearnis an online platform built to help ethical hackers learn and practice their cybersecurity knowledge.ctflearn.comctftimeCTF archive and a place, where you can get some another CTF-related info.ctftime.orgSilesia Security Labhigh quality security testing services.silesiasecuritylab.comPractical Pentest Labspentest lab, take your Hacking skills to the next level.practicalpentestlabs.comRoot Methe fast, easy, and affordable way to train your hacking skills.root-me.orgrozwal.toa great platform to train your pentesting skills.rozwal.toTryHackMelearning Cyber Security made easy.tryhackme.comhackxoris a realistic web application hacking game, designed to help players of all abilities develop their skills.hackxor.netHack Yourself Firstit's full of nasty app sec holes.hack-yourself-first.comOverTheWirecan help you to learn and practice security concepts in the form of fun-filled games.overthewire.orgWizard Labsis an online Penetration Testing Lab.labs.wizard-security.netPentesterLabprovides vulnerable systems that can be used to test and understand vulnerabilities.pentesterlab.comRingZer0tons of challenges designed to test and improve your hacking skills.ringzer0ctf.comtry2hackseveral security-oriented challenges for your entertainment.try2hack.nlUbeeripreconfigured lab environments.ubeeri.comPentestitemulate IT infrastructures of real companies for legal pen testing and improving pentest skills.lab.pentestit.ruMicrocorruptionreversal challenges done in the web interface.microcorruption.comCrackmesdownload crackmes to help improve your reverse engineering skills.crackmes.oneDomGoatDOM XSS security learning and practicing platform.domgo.atStereotyped Challengesupgrade your web hacking techniques today!chall.stypr.comVulnhuballows anyone to gain practical 'hands-on' experience in digital security.vulnhub.comW3Challsis a penetration testing training platform, which offers various computer challenges.w3challs.comRingZer0 CTFoffers you tons of challenges designed to test and improve your hacking skills.ringzer0ctf.comHack.mea platform where you can build, host and share vulnerable web apps for educational purposes.hack.meHackThis!discover how hacks, dumps and defacements are performed and secure your website.hackthis.co.ukEnigma Group WebApp Trainingthese challenges cover the exploits listed in the OWASP Top 10 Project.enigmagroup.orgReverse Engineering Challengeschallenges, exercises, problems and tasks - by level, by type, and more.challenges.re0x00secthe home of the Hacker - Malware, Reverse Engineering, and Computer Science.0x00sec.orgWe Challthere are exist a lots of different challenge types.wechall.netHacker Gatewayis the go-to place for hackers who want to test their skills.hackergateway.comHacker101is a free class for web security.hacker101.comcontained.afa stupid game for learning about containers, capabilities, and syscalls.contained.afflAWS challenge!a series of levels you'll learn about common mistakes and gotchas when using AWS.flaws.cloudCyberSec WTFprovides web hacking challenges derived from bounty write-ups.cybersecurity.wtfCTF ChallengeCTF Web App challenges.ctfchallenge.co.ukgCTFmost of the challenges used in the Google CTF 2017.capturetheflag.withgoogle.comHack This Siteis a free, safe and legal training ground for hackers.hackthissite.orgAttack & Defenseis a browser-based cloud labs.attackdefense.comCryptohacka fun platform for learning modern cryptography.cryptohack.orgCryptopalsthe cryptopals crypto challenges.cryptopals.com
#CTF platforms
#Other resources
Bugcrowd Universityopen source education content for the researcher community.github.comOSCPRepoa list of resources and scripts that I have been gathering in preparation for the OSCP.github.comOWASP Top 10: Real-World Examplestest your web apps with real-world examples (two-part series).medium.comphrack.organ awesome collection of articles from several respected hackers and other thinkers.phrack.orgPractical-Ethical-Hacking-Resourcescompilation of resources from TCM's Udemy Course.github.com
Your daily knowledge and news
#RSS Readers
#IRC Channels
#Security
The Hacker Newsleading news source dedicated to promoting awareness for security experts and hackers.thehackernews.comLatest Hacking Newsprovides the latest hacking news, exploits and vulnerabilities for ethical hackers.latesthackingnews.comSecurity Newslettersecurity news as a weekly digest (email notifications).securitynewsletter.coGoogle Online Security Blogthe latest news and insights from Google on security and safety on the Internet.security.googleblog.comQualys Blogexpert network security guidance and news.blog.qualys.comDARKReadingconnecting the Information Security Community.darkreading.comDarknetlatest hacking tools, hacker news, cybersecurity best practices, ethical hacking & pen-testing.darknet.org.ukpubliclyDisclosedpublic disclosure watcher who keeps you up to date about the recently disclosed bugs.twitter.comReddit - Hackinga subreddit dedicated to hacking and hackers.reddit.comPacket Storminformation security services, news, files, tools, exploits, advisories and whitepapers.packetstormsecurity.comSekurakabout security, penetration tests, vulnerabilities and many others (PL/EN).sekurak.plnf.secbasic aspects and mechanisms of Linux operating system security (PL).nfsec.pl
#Other/All-in-one
Other Cheat Sheets
Build your own DNS Servers
Unbound DNS Tutoriala validating, recursive, and caching DNS server.calomel.orgKnot Resolver on Fedorahow to get faster and more secure DNS resolution with Knot Resolver on Fedora.ctrl.blogDNS-over-HTTPStutorial to setup your own DNS-over-HTTPS (DoH) server.aaflalo.medns-over-httpsa cartoon intro to DNS over HTTPS.hacks.mozilla.orgDNS-over-TLSfollowing to your DoH server, setup your DNS-over-TLS (DoT) server.aaflalo.meDNS Servershow (and why) i run my own DNS Servers.zwischenzugs.com
Build your own Certificate Authority
OpenSSL Certificate Authoritybuild your own certificate authority (CA) using the OpenSSL tools.jamielinux.comstep-ca Certificate Authoritybuild your own certificate authority (CA) using open source step-ca.github.com
Build your own System/Virtual Machine
os-tutorialhow to create an OS from scratch.github.comWrite your Own Virtual Machinehow to write your own virtual machine (VM).justinmeiners.github.iox86 Bare Metal Examplesdozens of minimal operating systems to learn x86 system programming.github.comsimple-computerthe scott CPU from "But How Do It Know?" by J. Clark Scott.github.comlittleosbookthe little book about OS development.littleosbook.github.io
DNS Servers list (privacy)
| <b><u>IP</u></b> | <b><u>URL</u></b> | | :--- | :--- | | 84.200.69.80 | dns.watch | | 94.247.43.254 | opennic.org | | 64.6.64.6 | verisign.com | | 89.233.43.71 | censurfridns.dk | | 1.1.1.1 | cloudflare.com | | 94.130.110.185 | dnsprivacy.at |
TOP Browser extensions
| <b><u>Extension name</u></b> | <b><u>Description</u></b> | | :--- | :--- | | IPvFoo | Display the server IP address and HTTPS information across all page elements. | | FoxyProxy | Simplifies configuring browsers to access proxy-servers. | | HTTPS Everywhere | Automatically use HTTPS security on many sites. | | uMatrix | Point & click to forbid/allow any class of requests made by your browser. | | uBlock Origin | An efficient blocker: easy on memory and CPU footprint. | | Session Buddy | Manage browser tabs and bookmarks with ease. | | SuperSorter | Sort bookmarks recursively, delete duplicates, merge folders, and more. | | Clear Cache | Clear your cache and browsing data. | | d3coder | Encoding/Decoding plugin for various types of encoding. | | Web Developer | Adds a toolbar button with various web developer tools. | | ThreatPinch Lookup | Add threat intelligence hover tool tips. |
TOP Burp extensions
| <b><u>Extension name</u></b> | <b><u>Description</u></b> | | :--- | :--- | | Active Scan++ | Extends Burp's active and passive scanning capabilities. | | Autorize | Automatically detects authorization enforcement. | | AuthMatrix | A simple matrix grid to define the desired levels of access privilege. | | Logger++ | Logs requests and responses for all Burp tools in a sortable table. | | Bypass WAF | Adds headers useful for bypassing some WAF devices. | | JSON Beautifier | Beautifies JSON content in the HTTP message viewer. | | JSON Web Tokens | Enables Burp to decode and manipulate JSON web tokens. | | CSP Auditor | Displays CSP headers for responses, and passively reports CSP weaknesses. | | CSP-Bypass | Passively scans for CSP headers that contain known bypasses. | | Hackvertor | Converts data using a tag-based configuration to apply various encoding. | | HTML5 Auditor | Scans for usage of risky HTML5 features. | | Software Vulnerability Scanner | Vulnerability scanner based on vulners.com audit API. | | Turbo Intruder | Is a powerful bruteforcing tool. | | Upload Scanner | Upload a number of different file types, laced with different forms of payload. |
Hack Mozilla Firefox address bar
In Firefox's address bar, you can limit results by typing special characters before or after your term:
^- for matches in your browsing history*- for matches in your bookmarks.%- for matches in your currently open tabs.#- for matches in page titles.@- for matches in web addresses.
Chrome hidden commands
chrome://chrome-urls- list of all commandschrome://flags- enable experiments and development featureschrome://interstitials- errors and warningschrome://net-internals- network internals (events, dns, cache)chrome://network-errors- network errorschrome://net-export- start logging future network activity to a filechrome://safe-browsing- safe browsing optionschrome://user-actions- record all user actionschrome://restart- restart chromechrome://dino- ERR_INTERNET_DISCONNECTED...cache:<website-address>- view the cached version of the web page
Bypass WAFs by Shortening IP Address (by 0xInfection)
IP addresses can be shortened by dropping the zeroes:
http://1.0.0.1 → http://1.1
http://127.0.0.1 → http://127.1
http://192.168.0.1 → http://192.168.1
http://0xC0A80001 or http://3232235521 → 192.168.0.1
http://192.168.257 → 192.168.1.1
http://192.168.516 → 192.168.2.4> This bypasses WAF filters for SSRF, open-redirect, etc where any IP as input gets blacklisted.
For more information please see How to Obscure Any URL and Magic IP Address Shortcuts.
Hashing, encryption and encoding (by Michal Špaček)
_Hashing_
plaintext :arrow_right: hash<br> hash :no_entry: plaintext
_Symmetric encryption_
plaintext :arrow_right: :key: :arrow_right: ciphertext<br> plaintext :arrow_left: :key: :arrow_left: ciphertext<br> (:key: shared key)
_Asymmetric encryption_
plaintext :arrow_right: :key: :arrow_right: ciphertext<br> plaintext :arrow_left: :part_alternation_mark: :arrow_left: ciphertext<br> (:key: public key, :part_alternation_mark: private key)<br>
_Encoding_
text :arrow_right: encoded<br> text :arrow_left: encoded
Shell One-liners
#Table of Contents
#terminalman
Reload shell without exit
exec $SHELL -lClose shell keeping all subprocess running
disown -a && exitExit without saving shell history
kill -9 $$
unset HISTFILE && exitPerform a branching conditional
true && echo success
false || echo failedPipe stdout and stderr to separate commands
some_command > >(/bin/cmd_for_stdout) 2> >(/bin/cmd_for_stderr)Redirect stdout and stderr each to separate files and print both to the screen
(some_command 2>&1 1>&3 | tee errorlog ) 3>&1 1>&2 | tee stdoutlogList of commands you use most often
history | \
awk '{CMD[$2]++;count++;}END { for (a in CMD)print CMD[a] " " CMD[a]/count*100 "% " a;}' | \
grep -v "./" | \
column -c3 -s " " -t | \
sort -nr | nl | head -n 20Sterilize bash history
function sterile() {
history | awk '$2 != "history" { $1=""; print $0 }' | egrep -vi "\
curl\b+.*(-E|--cert)\b+.*\b*|\
curl\b+.*--pass\b+.*\b*|\
curl\b+.*(-U|--proxy-user).*:.*\b*|\
curl\b+.*(-u|--user).*:.*\b*
.*(-H|--header).*(token|auth.*)\b+.*|\
wget\b+.*--.*password\b+.*\b*|\
http.?://.+:.+@.*\
" > $HOME/histbuff; history -r $HOME/histbuff;
}
export PROMPT_COMMAND="sterile"> Look also: A naive utility to censor credentials in command history.
Quickly backup a file
cp filename{,.orig}Empty a file (truncate to 0 size)
>filenameDelete all files in a folder that don't match a certain file extension
rm !(*.foo|*.bar|*.baz)Pass multi-line string to a file
# cat >filename ... - overwrite the file
# cat >>filename ... - append to a file
cat > filename << __EOF__
data data data
__EOF__Edit a file on a remote host using vim
vim scp://user@host//etc/fstabCreate a directory and change into it at the same time
mkd() { mkdir -p "$@" && cd "$@"; }Convert uppercase files to lowercase files
rename 'y/A-Z/a-z/' *Print a row of characters across the terminal
printf "%`tput cols`s" | tr ' ' '#'Show shell history without line numbers
history | cut -c 8-
fc -l -n 1 | sed 's/^\s*//'Run command(s) after exit session
cat > /etc/profile << __EOF__
_after_logout() {
username=$(whoami)
for _pid in $(ps afx | grep sshd | grep "$username" | awk '{print $1}') ; do
kill -9 $_pid
done
}
trap _after_logout EXIT
__EOF__Generate a sequence of numbers
for ((i=1; i<=10; i+=2)) ; do echo $i ; done
# alternative: seq 1 2 10
for ((i=5; i<=10; ++i)) ; do printf '%02d\n' $i ; done
# alternative: seq -w 5 10
for i in {1..10} ; do echo $i ; doneSimple Bash filewatching
unset MAIL; export MAILCHECK=1; export MAILPATH='$FILE_TO_WATCH?$MESSAGE'#busyboxman
Static HTTP web server
busybox httpd -p $PORT -h $HOME [-c httpd.conf]#Tool: [mount](https://en.wikipedia.org/wiki/Mount_(Unix))
Mount a temporary ram partition
mount -t tmpfs tmpfs /mnt -o size=64M-t- filesystem type-o- mount options
Remount a filesystem as read/write
mount -o remount,rw /#Tool: [fuser](https://en.wikipedia.org/wiki/Fuser_(Unix))
Show which processes use the files/directories
fuser /var/log/daemon.log
fuser -v /home/supervisorKills a process that is locking a file
fuser -ki filename-i- interactive option
Kills a process that is locking a file with specific signal
fuser -k -HUP filename--list-signals- list available signal names
Show what PID is listening on specific port
fuser -v 53/udpShow all processes using the named filesystems or block device
fuser -mv /var/www#lsofman
Show process that use internet connection at the moment
lsof -P -i -nShow process that use specific port number
lsof -i tcp:443Lists all listening ports together with the PID of the associated process
lsof -Pan -i tcp -i udpList all open ports and their owning executables
lsof -i -P | grep -i "listen"Show all open ports
lsof -Pnl -iShow open ports (LISTEN)
lsof -Pni4 | grep LISTEN | column -tList all files opened by a particular command
lsof -c "process"View user activity per directory
lsof -u username -a +D /etcShow 10 largest open files
lsof / | \
awk '{ if($7 > 1048576) print $7/1048576 "MB" " " $9 " " $1 }' | \
sort -n -u | tail | column -tShow current working directory of a process
lsof -p <PID> | grep cwd#Tool: [ps](https://en.wikipedia.org/wiki/Ps_(Unix))
Show a 4-way scrollable process tree with full details
ps awwfux | less -SProcesses per user counter
ps hax -o user | sort | uniq -c | sort -rShow all processes by name with main header
ps -lfC nginx#Tool: [find](https://en.wikipedia.org/wiki/Find_(Unix))
Find files that have been modified on your system in the past 60 minutes
find / -mmin 60 -type fFind all files larger than 20M
find / -type f -size +20MFind duplicate files (based on MD5 hash)
find -type f -exec md5sum '{}' ';' | sort | uniq --all-repeated=separate -w 33Change permission only for files
cd /var/www/site && find . -type f -exec chmod 766 {} \;
cd /var/www/site && find . -type f -exec chmod 664 {} +Change permission only for directories
cd /var/www/site && find . -type d -exec chmod g+x {} \;
cd /var/www/site && find . -type d -exec chmod g+rwx {} +Find files and directories for specific user/group
# User:
find . -user <username> -print
find /etc -type f -user <username> -name "*.conf"
# Group:
find /opt -group <group>
find /etc -type f -group <group> -iname "*.conf"Find files and directories for all without specific user/group
# User:
find . \! -user <username> -print
# Group:
find . \! -group <group>Looking for files/directories that only have certain permission
# User
find . -user <username> -perm -u+rw # -rw-r--r--
find /home -user $(whoami) -perm 777 # -rwxrwxrwx
# Group:
find /home -type d -group <group> -perm 755 # -rwxr-xr-xDelete older files than 60 days
find . -type f -mtime +60 -deleteRecursively remove all empty sub-directories from a directory
find . -depth -type d -empty -exec rmdir {} \;How to find all hard links to a file
find </path/to/dir> -xdev -samefile filenameRecursively find the latest modified files
find . -type f -exec stat --format '%Y :%y %n' "{}" \; | sort -nr | cut -d: -f2- | headRecursively find/replace of a string with sed
find . -not -path '*/\.git*' -type f -print0 | xargs -0 sed -i 's/foo/bar/g'Recursively find/replace of a string in directories and file names
find . -depth -name '*test*' -execdir bash -c 'mv -v "$1" "${1//foo/bar}"' _ {} \;Recursively find suid executables
find / \( -perm -4000 -o -perm -2000 \) -type f -exec ls -la {} \;#Tool: [top](https://en.wikipedia.org/wiki/Top_(software))
Use top to monitor only all processes with the specific string
top -p $(pgrep -d , <str>)<str>- process containing string (eg. nginx, worker)
#vmstatman
Show current system utilization (fields in kilobytes)
vmstat 2 20 -t -w2- number of times with a defined time interval (delay)20- each execution of the command (count)-t- show timestamp-w- wide output-S M- output of the fields in megabytes instead of kilobytes
Show current system utilization will get refreshed every 5 seconds
vmstat 5 -wDisplay report a summary of disk operations
vmstat -DDisplay report of event counters and memory stats
vmstat -sDisplay report about kernel objects stored in slab layer cache
vmstat -m#iostatman
Show information about the CPU usage, and I/O statistics about all the partitions
iostat 2 10 -t -m2- number of times with a defined time interval (delay)10- each execution of the command (count)-t- show timestamp-m- fields in megabytes (-k- in kilobytes, default)
Show information only about the CPU utilization
iostat 2 10 -t -m -cShow information only about the disk utilization
iostat 2 10 -t -m -dShow information only about the LVM utilization
iostat -N#straceman
Track with child processes
# 1)
strace -f -p $(pidof glusterfsd)
# 2)
strace -f $(pidof php-fpm | sed 's/\([0-9]*\)/\-p \1/g')Track process with 30 seconds limit
timeout 30 strace $(< /var/run/zabbix/zabbix_agentd.pid)Track processes and redirect output to a file
ps auxw | grep '[a]pache' | awk '{print " -p " $2}' | \
xargs strace -o /tmp/strace-apache-proc.outTrack with print time spent in each syscall and limit length of print strings
ps auxw | grep '[i]init_policy' | awk '{print " -p " $2}' | \
xargs strace -f -e trace=network -T -s 10000Track the open request of a network port
strace -f -e trace=bind nc -l 80Track the open request of a network port (show TCP/UDP)
strace -f -e trace=network nc -lu 80#Tool: [kill](https://en.wikipedia.org/wiki/Kill_(command))
Kill a process running on port
kill -9 $(lsof -i :<port> | awk '{l=$2} END {print l}')#diffman
Compare two directory trees
diff <(cd directory1 && find | sort) <(cd directory2 && find | sort)Compare output of two commands
diff <(cat /etc/passwd) <(cut -f2 /etc/passwd)#vimdiffman
Highlight the exact differences, based on characters and words
vimdiff file1 file2Compare two JSON files
vimdiff <(jq -S . A.json) <(jq -S . B.json)Compare Hex dump
d(){ vimdiff <(f $1) <(f $2);};f(){ hexdump -C $1 | cut -d' ' -f3- | tr -s ' ';}; d ~/bin1 ~/bin2diffchar
Save diffchar @ ~/.vim/plugins
Click F7 to switch between diff modes
Usefull vimdiff commands:
qato exit all windows:vertical resize 70to resize window- set window width
Ctrl+W [N columns]+(Shift+)<\>
#Tool: [tail](https://en.wikipedia.org/wiki/Tail_(Unix))
Annotate tail -f with timestamps
tail -f file | while read ; do echo "$(date +%T.%N) $REPLY" ; doneAnalyse an Apache access log for the most common IP addresses
tail -10000 access_log | awk '{print $1}' | sort | uniq -c | sort -n | tailAnalyse web server log and show only 5xx http codes
tail -n 100 -f /path/to/logfile | grep "HTTP/[1-2].[0-1]\" [5]"#Tool: [tar](https://en.wikipedia.org/wiki/Tar_(computing))
System backup with exclude specific directories
cd /
tar -czvpf /mnt/system$(date +%d%m%Y%s).tgz --directory=/ \
--exclude=proc/* --exclude=sys/* --exclude=dev/* --exclude=mnt/* .System backup with exclude specific directories (pigz)
cd /
tar cvpf /backup/snapshot-$(date +%d%m%Y%s).tgz --directory=/ \
--exclude=proc/* --exclude=sys/* --exclude=dev/* \
--exclude=mnt/* --exclude=tmp/* --use-compress-program=pigz .#Tool: [dump](https://en.wikipedia.org/wiki/Dump_(program))
System backup to file
dump -y -u -f /backup/system$(date +%d%m%Y%s).lzo /Restore system from lzo file
cd /
restore -rf /backup/system$(date +%d%m%Y%s).lzo#cpulimitman
Limit the cpu usage of a process
cpulimit -p pid -l 50#pwdxman
Show current working directory of a process
pwdx <pid>#tasksetman
Start a command on only one CPU core
taskset -c 0 <command>#Tool: [tr](https://en.wikipedia.org/wiki/Tr_(Unix))
Show directories in the PATH, one per line
tr : '\n' <<<$PATH#chmodman
Remove executable bit from all files in the current directory
chmod -R -x+X *Restore permission for /bin/chmod
# 1:
cp /bin/ls chmod.01
cp /bin/chmod chmod.01
./chmod.01 700 file
# 2:
/bin/busybox chmod 0700 /bin/chmod
# 3:
setfacl --set u::rwx,g::---,o::--- /bin/chmod#Tool: [who](https://en.wikipedia.org/wiki/Who_(Unix))
Find last reboot time
who -bDetect a user sudo-su'd into the current shell
[[ $(who -m | awk '{ print $1 }') == $(whoami) ]] || echo "You are su-ed to $(whoami)"#lastman
Was the last reboot a panic?
(last -x -f $(ls -1t /var/log/wtmp* | head -2 | tail -1); last -x -f /var/log/wtmp) | \
grep -A1 reboot | head -2 | grep -q shutdown && echo "Expected reboot" || echo "Panic reboot"#screenman
Start screen in detached mode
screen -d -m <command>Attach to an existing screen session
screen -r -d <pid>#Tool: [script](https://en.wikipedia.org/wiki/Script_(Unix))
Record and replay terminal session
### Record session
# 1)
script -t 2>~/session.time -a ~/session.log
# 2)
script --timing=session.time session.log
### Replay session
scriptreplay --timing=session.time session.log#duman
Show 20 biggest directories with 'K M G'
du | \
sort -r -n | \
awk '{split("K M G",v); s=1; while($1>1024){$1/=1024; s++} print int($1)" "v[s]"\t"$2}' | \
head -n 20#inotifywaitman
Init tool everytime a file in a directory is modified
while true ; do inotifywait -r -e MODIFY dir/ && ls dir/ ; done;#opensslman
Testing connection to the remote host
echo | openssl s_client -connect google.com:443 -showcertsTesting connection to the remote host (debug mode)
echo | openssl s_client -connect google.com:443 -showcerts -tlsextdebug -statusTesting connection to the remote host (with SNI support)
echo | openssl s_client -showcerts -servername google.com -connect google.com:443Testing connection to the remote host with specific ssl version
openssl s_client -tls1_2 -connect google.com:443Testing connection to the remote host with specific ssl cipher
openssl s_client -cipher 'AES128-SHA' -connect google.com:443Verify 0-RTT
_host="example.com"
cat > req.in << __EOF__
HEAD / HTTP/1.1
Host: $_host
Connection: close
__EOF__
openssl s_client -connect ${_host}:443 -tls1_3 -sess_out session.pem -ign_eof < req.in
openssl s_client -connect ${_host}:443 -tls1_3 -sess_in session.pem -early_data req.inGenerate private key without passphrase
# _len: 2048, 4096
( _fd="private.key" ; _len="2048" ; \
openssl genrsa -out ${_fd} ${_len} )Generate private key with passphrase
# _ciph: aes128, aes256
# _len: 2048, 4096
( _ciph="aes128" ; _fd="private.key" ; _len="2048" ; \
openssl genrsa -${_ciph} -out ${_fd} ${_len} )Remove passphrase from private key
( _fd="private.key" ; _fd_unp="private_unp.key" ; \
openssl rsa -in ${_fd} -out ${_fd_unp} )Encrypt existing private key with a passphrase
# _ciph: aes128, aes256
( _ciph="aes128" ; _fd="private.key" ; _fd_pass="private_pass.key" ; \
openssl rsa -${_ciph} -in ${_fd} -out ${_fd_pass}Check private key
( _fd="private.key" ; \
openssl rsa -check -in ${_fd} )Get public key from private key
( _fd="private.key" ; _fd_pub="public.key" ; \
openssl rsa -pubout -in ${_fd} -out ${_fd_pub} )Generate private key and CSR
( _fd="private.key" ; _fd_csr="request.csr" ; _len="2048" ; \
openssl req -out ${_fd_csr} -new -newkey rsa:${_len} -nodes -keyout ${_fd} )Generate CSR
( _fd="private.key" ; _fd_csr="request.csr" ; \
openssl req -out ${_fd_csr} -new -key ${_fd} )Generate CSR (metadata from existing certificate)
> Where private.key is the existing private key. As you can see you do not generate this CSR from your certificate (public key). Also you do not generate the "same" CSR, just a new one to request a new certificate.
( _fd="private.key" ; _fd_csr="request.csr" ; _fd_crt="cert.crt" ; \
openssl x509 -x509toreq -in ${_fd_crt} -out ${_fd_csr} -signkey ${_fd} )Generate CSR with -config param
( _fd="private.key" ; _fd_csr="request.csr" ; \
openssl req -new -sha256 -key ${_fd} -out ${_fd_csr} \
-config <(
cat << __EOF__
[req]
default_bits = 2048
default_md = sha256
prompt = no
distinguished_name = dn
req_extensions = req_ext
[ dn ]
C = "<two-letter ISO abbreviation for your country>"
ST = "<state or province where your organisation is legally located>"
L = "<city where your organisation is legally located>"
O = "<legal name of your organisation>"
OU = "<section of the organisation>"
CN = "<fully qualified domain name>"
[ req_ext ]
subjectAltName = @alt_names
[ alt_names ]
DNS.1 = <fully qualified domain name>
DNS.2 = <next domain>
DNS.3 = <next domain>
__EOF__
))Other values in [ dn ]:
countryName = "DE" # C=
stateOrProvinceName = "Hessen" # ST=
localityName = "Keller" # L=
postalCode = "424242" # L/postalcode=
postalAddress = "Keller" # L/postaladdress=
streetAddress = "Crater 1621" # L/street=
organizationName = "apfelboymschule" # O=
organizationalUnitName = "IT Department" # OU=
commonName = "example.com" # CN=
emailAddress = "[email protected]" # CN/emailAddress=Example of oids (you'll probably also have to make OpenSSL know about the new fields required for EV by adding the following under [new_oids]):
[req]
...
oid_section = new_oids
[ new_oids ]
postalCode = 2.5.4.17
streetAddress = 2.5.4.9Full example:
( _fd="private.key" ; _fd_csr="request.csr" ; \
openssl req -new -sha256 -key ${_fd} -out ${_fd_csr} \
-config <(
cat << __EOF__
[req]
default_bits = 2048
default_md = sha256
prompt = no
distinguished_name = dn
req_extensions = req_ext
oid_section = new_oids
[ new_oids ]
serialNumber = 2.5.4.5
streetAddress = 2.5.4.9
postalCode = 2.5.4.17
businessCategory = 2.5.4.15
[ dn ]
serialNumber=00001111
businessCategory=Private Organization
jurisdictionC=DE
C=DE
ST=Hessen
L=Keller
postalCode=424242
streetAddress=Crater 1621
O=AV Company
OU=IT
CN=example.com
[ req_ext ]
subjectAltName = @alt_names
[ alt_names ]
DNS.1 = example.com
__EOF__
))For more information please look at these great explanations:
- RFC 5280
- How to create multidomain certificates using config files
- Generate a multi domains certificate using config files
- Your OpenSSL CSR command is out of date
- OpenSSL example configuration file
- Object Identifiers (OIDs)
- openssl objects.txt
List available EC curves
openssl ecparam -list_curvesPrint ECDSA private and public keys
( _fd="private.key" ; \
openssl ec -in ${_fd} -noout -text )
# For x25519 only extracting public key
( _fd="private.key" ; _fd_pub="public.key" ; \
openssl pkey -in ${_fd} -pubout -out ${_fd_pub} )Generate ECDSA private key
# _curve: prime256v1, secp521r1, secp384r1
( _fd="private.key" ; _curve="prime256v1" ; \
openssl ecparam -out ${_fd} -name ${_curve} -genkey )
# _curve: X25519
( _fd="private.key" ; _curve="x25519" ; \
openssl genpkey -algorithm ${_curve} -out ${_fd} )Generate private key and CSR (ECC)
# _curve: prime256v1, secp521r1, secp384r1
( _fd="domain.com.key" ; _fd_csr="domain.com.csr" ; _curve="prime256v1" ; \
openssl ecparam -out ${_fd} -name ${_curve} -genkey ; \
openssl req -new -key ${_fd} -out ${_fd_csr} -sha256 )Generate self-signed certificate
# _len: 2048, 4096
( _fd="domain.key" ; _fd_out="domain.crt" ; _len="2048" ; _days="365" ; \
openssl req -newkey rsa:${_len} -nodes \
-keyout ${_fd} -x509 -days ${_days} -out ${_fd_out} )Generate self-signed certificate from existing private key
# _len: 2048, 4096
( _fd="domain.key" ; _fd_out="domain.crt" ; _days="365" ; \
openssl req -key ${_fd} -nodes \
-x509 -days ${_days} -out ${_fd_out} )Generate self-signed certificate from existing private key and csr
# _len: 2048, 4096
( _fd="domain.key" ; _fd_csr="domain.csr" ; _fd_out="domain.crt" ; _days="365" ; \
openssl x509 -signkey ${_fd} -nodes \
-in ${_fd_csr} -req -days ${_days} -out ${_fd_out} )Generate DH public parameters
( _dh_size="2048" ; \
openssl dhparam -out /etc/nginx/ssl/dhparam_${_dh_size}.pem "$_dh_size" )Display DH public parameters
openssl pkeyparam -in dhparam.pem -textExtract private key from pfx
( _fd_pfx="cert.pfx" ; _fd_key="key.pem" ; \
openssl pkcs12 -in ${_fd_pfx} -nocerts -nodes -out ${_fd_key} )Extract private key and certs from pfx
( _fd_pfx="cert.pfx" ; _fd_pem="key_certs.pem" ; \
openssl pkcs12 -in ${_fd_pfx} -nodes -out ${_fd_pem} )Extract certs from p7b
# PKCS#7 file doesn't include private keys.
( _fd_p7b="cert.p7b" ; _fd_pem="cert.pem" ; \
openssl pkcs7 -inform DER -outform PEM -in ${_fd_p7b} -print_certs > ${_fd_pem})
# or:
openssl pkcs7 -print_certs -in -in ${_fd_p7b} -out ${_fd_pem})Convert DER to PEM
( _fd_der="cert.crt" ; _fd_pem="cert.pem" ; \
openssl x509 -in ${_fd_der} -inform der -outform pem -out ${_fd_pem} )Convert PEM to DER
( _fd_der="cert.crt" ; _fd_pem="cert.pem" ; \
openssl x509 -in ${_fd_pem} -outform der -out ${_fd_der} )Verification of the private key
( _fd="private.key" ; \
openssl rsa -noout -text -in ${_fd} )Verification of the public key
# 1)
( _fd="public.key" ; \
openssl pkey -noout -text -pubin -in ${_fd} )
# 2)
( _fd="private.key" ; \
openssl rsa -inform PEM -noout -in ${_fd} &> /dev/null ; \
if [ $? = 0 ] ; then echo -en "OK\n" ; fi )Verification of the certificate
( _fd="certificate.crt" ; # format: pem, cer, crt \
openssl x509 -noout -text -in ${_fd} )Verification of the CSR
( _fd_csr="request.csr" ; \
openssl req -text -noout -in ${_fd_csr} )Check the private key and the certificate are match
(openssl rsa -noout -modulus -in private.key | openssl md5 ; \
openssl x509 -noout -modulus -in certificate.crt | openssl md5) | uniqCheck the private key and the CSR are match
(openssl rsa -noout -modulus -in private.key | openssl md5 ; \
openssl req -noout -modulus -in request.csr | openssl md5) | uniq#secure-deleteman
Secure delete with shred
shred -vfuz -n 10 file
shred --verbose --random-source=/dev/urandom -n 1 /dev/sdaSecure delete with scrub
scrub -p dod /dev/sda
scrub -p dod -r fileSecure delete with badblocks
badblocks -s -w -t random -v /dev/sda
badblocks -c 10240 -s -w -t random -v /dev/sdaSecure delete with secure-delete
srm -vz /tmp/file
sfill -vz /local
sdmem -v
swapoff /dev/sda5 && sswap -vz /dev/sda5#Tool: [dd](https://en.wikipedia.org/wiki/Dd_(Unix))
Show dd status every so often
dd <dd_params> status=progress
watch --interval 5 killall -USR1 ddRedirect output to a file with dd
echo "string" | dd of=filename#gpgman
Export public key
gpg --export --armor "<username>" > username.pkey--export- export all keys from all keyrings or specific key-a|--armor- create ASCII armored output
Encrypt file
gpg -e -r "<username>" dump.sql-e|--encrypt- encrypt data-r|--recipient- encrypt for specific <username>
Decrypt file
gpg -o dump.sql -d dump.sql.gpg-o|--output- use as output file-d|--decrypt- decrypt data (default)
Search recipient
gpg --keyserver hkp://keyserver.ubuntu.com --search-keys "<username>"--keyserver- set specific key server--search-keys- search for keys on a key server
List all of the packets in an encrypted file
gpg --batch --list-packets archive.gpg
gpg2 --batch --list-packets archive.gpg#system-otherman
Reboot system from init
exec /sbin/init 6Init system from single user mode
exec /sbin/initShow current working directory of a process
readlink -f /proc/<PID>/cwdShow actual pathname of the executed command
readlink -f /proc/<PID>/exe#curlman
curl -Iks https://www.google.com-I- show response headers only-k- insecure connection when using ssl-s- silent mode (not display body)
curl -Iks --location -X GET -A "x-agent" https://www.google.com--location- follow redirects-X- set method-A- set user-agent
curl -Iks --location -X GET -A "x-agent" --proxy http://127.0.0.1:16379 https://www.google.com--proxy [socks5://|http://]- set proxy server
curl -o file.pdf -C - https://example.com/Aiju2goo0Ja2.pdf-o- write output to file-C- resume the transfer
Find your external IP address (external services)
curl ipinfo.io
curl ipinfo.io/ip
curl icanhazip.com
curl ifconfig.me/ip ; echoRepeat URL request
# URL sequence substitution with a dummy query string:
curl -ks https://example.com/?[1-20]
# With shell 'for' loop:
for i in {1..20} ; do curl -ks https://example.com/ ; doneCheck DNS and HTTP trace with headers for specific domains
### Set domains and external dns servers.
_domain_list=(google.com) ; _dns_list=("8.8.8.8" "1.1.1.1")
for _domain in "${_domain_list[@]}" ; do
printf '=%.0s' {1..48}
echo
printf "[\\e[1;32m+\\e[m] resolve: %s\\n" "$_domain"
for _dns in "${_dns_list[@]}" ; do
# Resolve domain.
host "${_domain}" "${_dns}"
echo
done
for _proto in http https ; do
printf "[\\e[1;32m+\\e[m] trace + headers: %s://%s\\n" "$_proto" "$_domain"
# Get trace and http headers.
curl -Iks -A "x-agent" --location "${_proto}://${_domain}"
echo
done
done
unset _domain_list _dns_list#httpieman
http -p Hh https://www.google.com-p- print request and response headersH- request headersB- request bodyh- response headersb- response body
http -p Hh https://www.google.com --follow --verify no-F, --follow- follow redirects--verify no- skip SSL verification
http -p Hh https://www.google.com --follow --verify no \
--proxy http:http://127.0.0.1:16379--proxy [http:]- set proxy server
#sshman
Escape Sequence
# Supported escape sequences:
~. - terminate connection (and any multiplexed sessions)
~B - send a BREAK to the remote system
~C - open a command line
~R - Request rekey (SSH protocol 2 only)
~^Z - suspend ssh
~# - list forwarded connections
~& - background ssh (when waiting for connections to terminate)
~? - this message
~~ - send the escape character by typing it twiceCompare a remote file with a local file
ssh user@host cat /path/to/remotefile | diff /path/to/localfile -SSH connection through host in the middle
ssh -t reachable_host ssh unreachable_hostRun command over SSH on remote host
cat > cmd.txt << __EOF__
cat /etc/hosts
__EOF__
ssh host -l user $(<cmd.txt)Get public key from private key
ssh-keygen -y -f ~/.ssh/id_rsaGet all fingerprints
ssh-keygen -l -f .ssh/known_hostsSSH authentication with user password
ssh -o PreferredAuthentications=password -o PubkeyAuthentication=no user@remote_hostSSH authentication with publickey
ssh -o PreferredAuthentications=publickey -o PubkeyAuthentication=yes -i id_rsa user@remote_hostSimple recording SSH session
function _ssh_sesslog() {
_sesdir="<path/to/session/logs>"
mkdir -p "${_sesdir}" && \
ssh $@ 2>&1 | tee -a "${_sesdir}/$(date +%Y%m%d).log"
}
# Alias:
alias ssh='_ssh_sesslog'Using Keychain for SSH logins
### Delete all of ssh-agent's keys.
function _scl() {
/usr/bin/keychain --clear
}
### Add key to keychain.
function _scg() {
/usr/bin/keychain /path/to/private-key
source "$HOME/.keychain/$HOSTNAME-sh"
}SSH login without processing any login scripts
ssh -tt user@host bashSSH local port forwarding
Example 1:
# Forwarding our local 2250 port to nmap.org:443 from localhost through localhost
host1> ssh -L 2250:nmap.org:443 localhost
# Connect to the service:
host1> curl -Iks --location -X GET https://localhost:2250Example 2:
# Forwarding our local 9051 port to db.d.x:5432 from localhost through node.d.y
host1> ssh -nNT -L 9051:db.d.x:5432 node.d.y
# Connect to the service:
host1> psql -U db_user -d db_dev -p 9051 -h localhost-n- redirects stdin from/dev/null-N- do not execute a remote command-T- disable pseudo-terminal allocation
SSH remote port forwarding
# Forwarding our local 9051 port to db.d.x:5432 from host2 through node.d.y
host1> ssh -nNT -R 9051:db.d.x:5432 node.d.y
# Connect to the service:
host2> psql -U postgres -d postgres -p 8000 -h localhost#linux-devman
Testing remote connection to port
timeout 1 bash -c "</dev/<proto>/<host>/<port>" >/dev/null 2>&1 ; echo $?<proto- set protocol (tcp/udp)<host>- set remote host<port>- set destination port
Read and write to TCP or UDP sockets with common bash tools
exec 5<>/dev/tcp/<host>/<port>; cat <&5 & cat >&5; exec 5>&-#tcpdumpman
Filter incoming (on interface) traffic (specific <ip:port>)
tcpdump -ne -i eth0 -Q in host 192.168.252.1 and port 443-n- don't convert addresses (-nnwill not resolve hostnames or ports)-e- print the link-level headers-i [iface|any]- set interface-Q|-D [in|out|inout]- choose send/receive direction (-D- for old tcpdump versions)host [ip|hostname]- set host, also[host not][and|or]- set logicport [1-65535]- set port number, also[port not]
Filter incoming (on interface) traffic (specific <ip:port>) and write to a file
tcpdump -ne -i eth0 -Q in host 192.168.252.1 and port 443 -c 5 -w tcpdump.pcap-c [num]- capture only num number of packets-w [filename]- write packets to file,-r [filename]- reading from file
Capture all ICMP packets
tcpdump -nei eth0 icmpCheck protocol used (TCP or UDP) for service
tcpdump -nei eth0 tcp port 22 -vv -X | egrep "TCP|UDP"Display ASCII text (to parse the output using grep or other)
tcpdump -i eth0 -A -s0 port 443Grab everything between two keywords
tcpdump -i eth0 port 80 -X | sed -n -e '/username/,/=ldap/ p'Grab user and pass ever plain http
tcpdump -i eth0 port http -l -A | egrep -i \
'pass=|pwd=|log=|login=|user=|username=|pw=|passw=|passwd=|password=|pass:|user:|username:|password:|login:|pass |user ' \
--color=auto --line-buffered -B20Extract HTTP User Agent from HTTP request header
tcpdump -ei eth0 -nn -A -s1500 -l | grep "User-Agent:"Capture only HTTP GET and POST packets
tcpdump -ei eth0 -s 0 -A -vv \
'tcp[((tcp[12:1] & 0xf0) >> 2):4] = 0x47455420' or 'tcp[((tcp[12:1] & 0xf0) >> 2):4] = 0x504f5354'or simply:
tcpdump -ei eth0 -s 0 -v -n -l | egrep -i "POST /|GET /|Host:"Rotate capture files
tcpdump -ei eth0 -w /tmp/capture-%H.pcap -G 3600 -C 200-G <num>- pcap will be created every<num>seconds-C <size>- close the current pcap and open a new one if is larger than<size>
Top hosts by packets
tcpdump -ei enp0s25 -nnn -t -c 200 | cut -f 1,2,3,4 -d '.' | sort | uniq -c | sort -nr | head -n 20Excludes any RFC 1918 private address
tcpdump -nei eth0 'not (src net (10 or 172.16/12 or 192.168/16) and dst net (10 or 172.16/12 or 192.168/16))'#tcpickman
Analyse packets in real-time
while true ; do tcpick -a -C -r dump.pcap ; sleep 2 ; clear ; done#ngrepman
ngrep -d eth0 "www.domain.com" port 443-d [iface|any]- set interface[domain]- set hostnameport [1-65535]- set port number
ngrep -d eth0 "www.domain.com" src host 10.240.20.2 and port 443(host [ip|hostname])- filter by ip or hostname(port [1-65535])- filter by port number
ngrep -d eth0 -qt -O ngrep.pcap "www.domain.com" port 443-q- quiet mode (only payloads)-t- added timestamps-O [filename]- save output to file,-I [filename]- reading from file
ngrep -d eth0 -qt 'HTTP' 'tcp'HTTP- show http headerstcp|udp- set protocol[src|dst] host [ip|hostname]- set direction for specific node
ngrep -l -q -d eth0 -i "User-Agent: curl*"-l- stdout line buffered-i- case-insensitive search
#hping3man
hping3 -V -p 80 -s 5050 <scan_type> www.google.com-V|--verbose- verbose mode-p|--destport- set destination port-s|--baseport- set source port<scan_type>- set scan type-F|--fin- set FIN flag, port open if no reply-S|--syn- set SYN flag-P|--push- set PUSH flag-A|--ack- set ACK flag (use when ping is blocked, RST response back if the port is open)-U|--urg- set URG flag-Y|--ymas- set Y unused flag (0x80 - nullscan), port open if no reply-M 0 -UPF- set TCP sequence number and scan type (URG+PUSH+FIN), port open if no reply
hping3 -V -c 1 -1 -C 8 www.google.com-c [num]- packet count-1- set ICMP mode-C|--icmptype [icmp-num]- set icmp type (default icmp-echo = 8)
hping3 -V -c 1000000 -d 120 -S -w 64 -p 80 --flood --rand-source <remote_host>--flood- sent packets as fast as possible (don't show replies)--rand-source- random source address mode-d --data- data size-w|--win- winsize (default 64)
#nmapman
Ping scans the network
nmap -sP 192.168.0.0/24Show only open ports
nmap -F --open 192.168.0.0/24Full TCP port scan using with service version detection
nmap -p 1-65535 -sV -sS -T4 192.168.0.0/24Nmap scan and pass output to Nikto
nmap -p80,443 192.168.0.0/24 -oG - | nikto.pl -h -Recon specific ip:service with Nmap NSE scripts stack
# Set variables:
_hosts="192.168.250.10"
_ports="80,443"
# Set Nmap NSE scripts stack:
_nmap_nse_scripts="+dns-brute,\
+http-auth-finder,\
+http-chrono,\
+http-cookie-flags,\
+http-cors,\
+http-cross-domain-policy,\
+http-csrf,\
+http-dombased-xss,\
+http-enum,\
+http-errors,\
+http-git,\
+http-grep,\
+http-internal-ip-disclosure,\
+http-jsonp-detection,\
+http-malware-host,\
+http-methods,\
+http-passwd,\
+http-phpself-xss,\
+http-php-version,\
+http-robots.txt,\
+http-sitemap-generator,\
+http-shellshock,\
+http-stored-xss,\
+http-title,\
+http-unsafe-output-escaping,\
+http-useragent-tester,\
+http-vhosts,\
+http-waf-detect,\
+http-waf-fingerprint,\
+http-xssed,\
+traceroute-geolocation.nse,\
+ssl-enum-ciphers,\
+whois-domain,\
+whois-ip"
# Set Nmap NSE script params:
_nmap_nse_scripts_args="dns-brute.domain=${_hosts},http-cross-domain-policy.domain-lookup=true,"
_nmap_nse_scripts_args+="http-waf-detect.aggro,http-waf-detect.detectBodyChanges,"
_nmap_nse_scripts_args+="http-waf-fingerprint.intensive=1"
# Perform scan:
nmap --script="$_nmap_nse_scripts" --script-args="$_nmap_nse_scripts_args" -p "$_ports" "$_hosts"#netcatman
nc -kl 5000-l- listen for an incoming connection-k- listening after client has disconnected>filename.out- save receive data to file (optional)
nc 192.168.0.1 5051 < filename.in< filename.in- send data to remote host
nc -vz 10.240.30.3 5000-v- verbose output-z- scan for listening daemons
nc -vzu 10.240.30.3 1-65535-u- scan only udp ports
Transfer data file (archive)
server> nc -l 5000 | tar xzvfp -
client> tar czvfp - /path/to/dir | nc 10.240.30.3 5000Launch remote shell
# 1)
server> nc -l 5000 -e /bin/bash
client> nc 10.240.30.3 5000
# 2)
server> rm -f /tmp/f; mkfifo /tmp/f
server> cat /tmp/f | /bin/bash -i 2>&1 | nc -l 127.0.0.1 5000 > /tmp/f
client> nc 10.240.30.3 5000Simple file server
while true ; do nc -l 5000 | tar -xvf - ; doneSimple minimal HTTP Server
while true ; do nc -l -p 1500 -c 'echo -e "HTTP/1.1 200 OK\n\n $(date)"' ; doneSimple HTTP Server
> Restarts web server after each request - remove while condition for only single connection.
cat > index.html << __EOF__
<!doctype html>
<head>
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1">
<title></title>
<meta name="description" content="">
<meta name="viewport" content="width=device-width, initial-scale=1">
</head>
<body>
<p>
Hello! It's a site.
</p>
</body>
</html>
__EOF__server> while : ; do \
(echo -ne "HTTP/1.1 200 OK\r\nContent-Length: $(wc -c <index.html)\r\n\r\n" ; cat index.html;) | \
nc -l -p 5000 \
; done-p- port number
Simple HTTP Proxy (single connection)
#!/usr/bin/env bash
if [[ $# != 2 ]] ; then
printf "%s\\n" \
"usage: ./nc-proxy listen-port bk_host:bk_port"
fi
_listen_port="$1"
_bk_host=$(echo "$2" | cut -d ":" -f1)
_bk_port=$(echo "$2" | cut -d ":" -f2)
printf " lport: %s\\nbk_host: %s\\nbk_port: %s\\n\\n" \
"$_listen_port" "$_bk_host" "$_bk_port"
_tmp=$(mktemp -d)
_back="$_tmp/pipe.back"
_sent="$_tmp/pipe.sent"
_recv="$_tmp/pipe.recv"
trap 'rm -rf "$_tmp"' EXIT
mkfifo -m 0600 "$_back" "$_sent" "$_recv"
sed "s/^/=> /" <"$_sent" &
sed "s/^/<= /" <"$_recv" &
nc -l -p "$_listen_port" <"$_back" | \
tee "$_sent" | \
nc "$_bk_host" "$_bk_port" | \
tee "$_recv" >"$_back"server> chmod +x nc-proxy && ./nc-proxy 8080 192.168.252.10:8000
lport: 8080
bk_host: 192.168.252.10
bk_port: 8000
client> http -p h 10.240.30.3:8080
HTTP/1.1 200 OK
Accept-Ranges: bytes
Cache-Control: max-age=31536000
Content-Length: 2748
Content-Type: text/html; charset=utf-8
Date: Sun, 01 Jul 2018 20:12:08 GMT
Last-Modified: Sun, 01 Apr 2018 21:53:37 GMTCreate a single-use TCP or UDP proxy
### TCP -> TCP
nc -l -p 2000 -c "nc [ip|hostname] 3000"
### TCP -> UDP
nc -l -p 2000 -c "nc -u [ip|hostname] 3000"
### UDP -> UDP
nc -l -u -p 2000 -c "nc -u [ip|hostname] 3000"
### UDP -> TCP
nc -l -u -p 2000 -c "nc [ip|hostname] 3000"#gnutls-climan
Testing connection to remote host (with SNI support)
gnutls-cli -p 443 google.comTesting connection to remote host (without SNI support)
gnutls-cli --disable-sni -p 443 google.com#socatman
Testing remote connection to port
socat - TCP4:10.240.30.3:22-- standard input (STDIO)TCP4:<params>- set tcp4 connection with specific params[hostname|ip]- set hostname/ip[1-65535]- set port number
Redirecting TCP-traffic to a UNIX domain socket under Linux
socat TCP-LISTEN:1234,bind=127.0.0.1,reuseaddr,fork,su=nobody,range=127.0.0.0/8 UNIX-CLIENT:/tmp/fooTCP-LISTEN:<params>- set tcp listen with specific params[1-65535]- set port numberbind=[hostname|ip]- set bind hostname/ipreuseaddr- allows other sockets to bind to an addressfork- keeps the parent process attempting to produce more connectionssu=nobody- set userrange=[ip-range]- ip rangeUNIX-CLIENT:<params>- communicates with the specified peer socketfilename- define socket
#p0fman
Set iface in promiscuous mode and dump traffic to the log file
p0f -i enp0s25 -p -d -o /dump/enp0s25.log-i- listen on the specified interface-p- set interface in promiscuous mode-d- fork into background-o- output file
#netstatman
Graph # of connections for each hosts
netstat -an | awk '/ESTABLISHED/ { split($5,ip,":"); if (ip[1] !~ /^$/) print ip[1] }' | \
sort | uniq -c | awk '{ printf("%s\t%s\t",$2,$1) ; for (i = 0; i < $1; i++) {printf("*")}; print "" }'Monitor open connections for specific port including listen, count and sort it per IP
watch "netstat -plan | grep :443 | awk {'print \$5'} | cut -d: -f 1 | sort | uniq -c | sort -nk 1"Grab banners from local IPv4 listening ports
netstat -nlt | grep 'tcp ' | grep -Eo "[1-9][0-9]*" | xargs -I {} sh -c "echo "" | nc -v -n -w1 127.0.0.1 {}"#rsyncman
Rsync remote data as root using sudo
rsync --rsync-path 'sudo rsync' username@hostname:/path/to/dir/ /local/#Tool: [host](https://en.wikipedia.org/wiki/Host_(Unix))
Resolves the domain name (using external dns server)
host google.com 9.9.9.9Checks the domain administrator (SOA record)
host -t soa google.com 9.9.9.9#Tool: [dig](https://en.wikipedia.org/wiki/Dig_(command))
Resolves the domain name (short output)
dig google.com +shortLookup NS record for specific domain
dig @9.9.9.9 google.com NSQuery only answer section
dig google.com +nocomments +noquestion +noauthority +noadditional +nostatsQuery ALL DNS Records
dig google.com ANY +noall +answerDNS Reverse Look-up
dig -x 172.217.16.14 +short#certbotman
Generate multidomain certificate
certbot certonly -d example.com -d www.example.comGenerate wildcard certificate
certbot certonly --manual --preferred-challenges=dns -d example.com -d *.example.comGenerate certificate with 4096 bit private key
certbot certonly -d example.com -d www.example.com --rsa-key-size 4096#network-otherman
Get all subnets for specific AS (Autonomous system)
AS="AS32934"
whois -h whois.radb.net -- "-i origin ${AS}" | \
grep "^route:" | \
cut -d ":" -f2 | \
sed -e 's/^[ \t]//' | \
sort -n -t . -k 1,1 -k 2,2 -k 3,3 -k 4,4 | \
cut -d ":" -f2 | \
sed -e 's/^[ \t]/allow /' | \
sed 's/$/;/' | \
sed 's/allow */subnet -> /g'Resolves domain name from dns.google.com with curl and jq
_dname="google.com" ; curl -s "https://dns.google.com/resolve?name=${_dname}&type=A" | jq .#gitman
Log alias for a decent view of your repo
# 1)
git log --oneline --decorate --graph --all
# 2)
git log --graph \
--pretty=format:'%Cred%h%Creset -%C(yellow)%d%Creset %s %Cgreen(%cr) %C(bold blue)<%an>%Creset' \
--abbrev-commit#pythonman
Static HTTP web server
# Python 3.x
python3 -m http.server 8000 --bind 127.0.0.1
# Python 2.x
python -m SimpleHTTPServer 8000Static HTTP web server with SSL support
# Python 3.x
from http.server import HTTPServer, BaseHTTPRequestHandler
import ssl
httpd = HTTPServer(('localhost', 4443), BaseHTTPRequestHandler)
httpd.socket = ssl.wrap_socket (httpd.socket,
keyfile="path/to/key.pem",
certfile='path/to/cert.pem', server_side=True)
httpd.serve_forever()
# Python 2.x
import BaseHTTPServer, SimpleHTTPServer
import ssl
httpd = BaseHTTPServer.HTTPServer(('localhost', 4443),
SimpleHTTPServer.SimpleHTTPRequestHandler)
httpd.socket = ssl.wrap_socket (httpd.socket,
keyfile="path/tp/key.pem",
certfile='path/to/cert.pem', server_side=True)
httpd.serve_forever()Encode base64
python -m base64 -e <<< "sample string"Decode base64
python -m base64 -d <<< "dGhpcyBpcyBlbmNvZGVkCg=="#awkman
Search for matching lines
# egrep foo
awk '/foo/' filenameSearch non matching lines
# egrep -v foo
awk '!/foo/' filenamePrint matching lines with numbers
# egrep -n foo
awk '/foo/{print FNR,$0}' filenamePrint the last column
awk '{print $NF}' filenameFind all the lines longer than 80 characters
awk 'length($0)>80{print FNR,$0}' filenamePrint only lines of less than 80 characters
awk 'length < 80' filenamePrint double new lines a file
awk '1; { print "" }' filenamePrint line numbers
awk '{ print FNR "\t" $0 }' filename
awk '{ printf("%5d : %s\n", NR, $0) }' filename # in a fancy mannerPrint line numbers for only non-blank lines
awk 'NF { $0=++a " :" $0 }; { print }' filenamePrint the line and the next two (i=5) lines after the line matching regexp
awk '/foo/{i=5+1;}{if(i){i--; print;}}' filenamePrint the lines starting at the line matching 'server {' until the line matching '}'
awk '/server {/,/}/' filenamePrint multiple columns with separators
awk -F' ' '{print "ip:\t" $2 "\n port:\t" $3' filenameRemove empty lines
awk 'NF > 0' filename
# alternative:
awk NF filenameDelete trailing white space (spaces, tabs)
awk '{sub(/[ \t]*$/, "");print}' filenameDelete leading white space
awk '{sub(/^[ \t]+/, ""); print}' filenameRemove duplicate consecutive lines
# uniq
awk 'a !~ $0{print}; {a=$0}' filenameRemove duplicate entries in a file without sorting
awk '!x[$0]++' filenameExclude multiple columns
awk '{$1=$3=""}1' filenameSubstitute foo for bar on lines matching regexp
awk '/regexp/{gsub(/foo/, "bar")};{print}' filenameAdd some characters at the beginning of matching lines
awk '/regexp/{sub(/^/, "++++"); print;next;}{print}' filenameGet the last hour of Apache logs
awk '/'$(date -d "1 hours ago" "+%d\\/%b\\/%Y:%H:%M")'/,/'$(date "+%d\\/%b\\/%Y:%H:%M")'/ { print $0 }' \
/var/log/httpd/access_log#sedman
Print a specific line from a file
sed -n 10p /path/to/fileRemove a specific line from a file
sed -i 10d /path/to/file
# alternative (BSD): sed -i'' 10d /path/to/fileRemove a range of lines from a file
sed -i <file> -re '<start>,<end>d'Replace newline(s) with a space
sed ':a;N;$!ba;s/\n/ /g' /path/to/file
# cross-platform compatible syntax:
sed -e ':a' -e 'N' -e '$!ba' -e 's/\n/ /g' /path/to/file:acreate a labelaNappend the next line to the pattern space$!if not the last line, ba branch (go to) labelassubstitute,/\n/regex for new line,/ /by a space,/gglobal match (as many times as it can)
Alternatives:
# perl version (sed-like speed):
perl -p -e 's/\n/ /' /path/to/file
# bash version (slow):
while read line ; do printf "%s" "$line " ; done < fileDelete string +N next lines
sed '/start/,+4d' /path/to/file#grepman
Search for a "pattern" inside all files in the current directory
grep -rn "pattern"
grep -RnisI "pattern" *
fgrep "pattern" * -RShow only for multiple patterns
grep 'INFO*'\''WARN' filename
grep 'INFO\|WARN' filename
grep -e INFO -e WARN filename
grep -E '(INFO|WARN)' filename
egrep "INFO|WARN" filenameExcept multiple patterns
grep -vE '(error|critical|warning)' filenameShow data from file without comments
grep -v ^[[:space:]]*# filenameShow data from file without comments and new lines
egrep -v '#|^$' filenameShow strings with a dash/hyphen
grep -e -- filename
grep -- -- filename
grep "\-\-" filenameRemove blank lines from a file and save output to new file
grep . filename > newfilename#perlman
Search and replace (in place)
perl -i -pe's/SEARCH/REPLACE/' filenameEdit of
*.conf files changing all foo to bar (and backup original)perl -p -i.orig -e 's/\bfoo\b/bar/g' *.confPrints the first 20 lines from
*.conf filesperl -pe 'exit if $. > 20' *.confSearch lines 10 to 20
perl -ne 'print if 10 .. 20' filenameDelete first 10 lines (and backup original)
perl -i.orig -ne 'print unless 1 .. 10' filenameDelete all but lines between foo and bar (and backup original)
perl -i.orig -ne 'print unless /^foo$/ .. /^bar$/' filenameReduce multiple blank lines to a single line
perl -p -i -00pe0 filenameConvert tabs to spaces (1t = 2sp)
perl -p -i -e 's/\t/ /g' filenameRead input from a file and report number of lines and characters
perl -lne '$i++; $in += length($_); END { print "$i lines, $in characters"; }' filenameShell Tricks
When you get a shell, it is generally not very clean, but after following these steps, you will have a fairly clean and comfortable shell to work with.
script /dev/null -c bash- Ctrl-Z (to send it to background)
stty raw -echo; fg(returns the shell to foreground)reset(to reset terminal)xterm(when asked for terminal type)export TERM=xterm; export SHELL=bash
Shell functions
#Table of Contents
Domain resolve
# Dependencies:
# - curl
# - jq
function DomainResolve() {
local _host="$1"
local _curl_base="curl --request GET"
local _timeout="15"
_host_ip=$($_curl_base -ks -m "$_timeout" "https://dns.google.com/resolve?name=${_host}&type=A" | \
jq '.Answer[0].data' | tr -d "\"" 2>/dev/null)
if [[ -z "$_host_ip" ]] || [[ "$_host_ip" == "null" ]] ; then
echo -en "Unsuccessful domain name resolution.\\n"
else
echo -en "$_host > $_host_ip\\n"
fi
}Example:
shell> DomainResolve nmap.org
nmap.org > 45.33.49.119
shell> DomainResolve nmap.org
Unsuccessful domain name resolution.Get ASN
# Dependencies:
# - curl
function GetASN() {
local _ip="$1"
local _curl_base="curl --request GET"
local _timeout="15"
_asn=$($_curl_base -ks -m "$_timeout" "http://ip-api.com/line/${_ip}?fields=as")
_state=$(echo $?)
if [[ -z "$_ip" ]] || [[ "$_ip" == "null" ]] || [[ "$_state" -ne 0 ]]; then
echo -en "Unsuccessful ASN gathering.\\n"
else
echo -en "$_ip > $_asn\\n"
fi
}Example:
shell> GetASN 1.1.1.1
1.1.1.1 > AS13335 Cloudflare, Inc.
shell> GetASN 0.0.0.0
Unsuccessful ASN gathering.No matches for "".
Try a tool name like nmap, ssl or docker.