Notebook ATPP

https://notebook-atpp.onrender.com
Admin
A comprehensive technical notebook and knowledge base covering multiple programming languages,...
Tokens:81,408
Snippets:691
Trust Score:6.3
Update:9 months ago
Show doc for...
Tokens:
Raw
### Rootless Docker Setup

Source: https://notebook-atpp.onrender.com/docker/index

Installs and configures Docker to run in rootless mode using the provided script. This enhances security by avoiding the need for root privileges.

```bash
dockerd-rootless-setuptool.sh install
```

--------------------------------

### Initialize and Serve Docsify Documentation

Source: https://notebook-atpp.onrender.com/web/index

This snippet shows the commands to install Docsify CLI globally, initialize a new documentation project, navigate into the project directory, and start a local development server.

```bash
npm i docsify-cli -g

docsify init ./help

cd help // [!code focus]

docsify serve .
```

--------------------------------

### Start Minikube with Docker Runtime and Image Mirror

Source: https://notebook-atpp.onrender.com/docker/index

Starts a Minikube cluster using the Docker container runtime and specifying a Chinese image mirror.

```bash
minikube start  --container-runtime=docker --image-mirror-country='cn'
```

--------------------------------

### Installing Pip using get-pip.py

Source: https://notebook-atpp.onrender.com/python/index

Executes the downloaded get-pip.py script to install or upgrade pip.

```python
python get-pip.py
```

--------------------------------

### Install Minikube Binary

Source: https://notebook-atpp.onrender.com/docker/index

Downloads the Minikube binary for Linux amd64, makes it executable, and moves it to the system's PATH. This is a manual installation method.

```bash
curl -Lo minikube https://github.com/kubernetes/minikube/releases/download/v1.5.0/minikube-linux-amd64 && chmod +x minikube && sudo mv minikube /usr/local/bin/
```

--------------------------------

### Start Minikube with VMware Driver and Image Mirror

Source: https://notebook-atpp.onrender.com/docker/index

Starts a Minikube cluster using the VMware driver, specifying a Chinese image mirror. This can speed up image pulls in certain regions.

```bash
minikube start --image-mirror-country='cn' --driver=vmware
```

--------------------------------

### Start Minikube with Docker Driver and Custom Repository

Source: https://notebook-atpp.onrender.com/docker/index

Starts a Minikube cluster using the Docker driver, allocating specific memory and CPU resources, and configuring a custom image repository.

```bash
minikube start --driver=docker   --image-mirror-country='cn' -memory=2048 --cpus=2 --image-repository='registry.cn-hangzhou.aliyuncs.com/google_containers'
```

--------------------------------

### NVM Installation Files

Source: https://notebook-atpp.onrender.com/tools/index

This section lists files related to the Node Version Manager (NVM) installation. It includes a zip archive for a no-install version and an install script, along with specific version numbers that might be managed by NVM.

```plaintext
nvm-noinstall.zip

install.cmd

v20.0.0
v20.0.1
```

--------------------------------

### Install MicroK8s

Source: https://notebook-atpp.onrender.com/docker/index

Installs MicroK8s, a lightweight Kubernetes distribution, using snap. The `--channel=1.12/stable` flag specifies the Kubernetes version.

```bash
sudo snap install microk8s --classic --channel=1.12/stable
```

--------------------------------

### Start Minikube with VMware Driver, Specific Version, and Mirrors

Source: https://notebook-atpp.onrender.com/docker/index

Starts a Minikube cluster with the VMware driver, specifying a Kubernetes version, an image repository, and a registry mirror. This allows for precise control over the cluster environment.

```bash
minikube start --driver=vmware --image-mirror-country=cn --kubernetes-version=1.23.9 --image-repository=registry.cn-hangzhou.aliyuncs.com/google_containers --registry-mirror=https://registry.docker-cn.com
```

--------------------------------

### Starting a Simple HTTP Server

Source: https://notebook-atpp.onrender.com/python/index

Starts a basic HTTP server in the current directory on port 8080. This is useful for quickly serving static files for testing or local development.

```bash
python -m http.server 8080
```

--------------------------------

### Starting a Simple HTTP Server (Port 80)

Source: https://notebook-atpp.onrender.com/python/index

Starts a basic HTTP server in the current directory on port 80. This is useful for quickly serving static files for testing or local development.

```bash
python -m http.server 80
```

--------------------------------

### GitHub Actions Workflow for Batch Client

Source: https://notebook-atpp.onrender.com/git/index

This GitHub Actions workflow automates the setup, installation, and execution of a Python script for a batch client. It runs on Ubuntu, sets the timezone, checks out the code, sets up Python with caching, installs dependencies, and runs the batch script. It is triggered on push, pull request, and scheduled runs.

```yaml
name: Batch-Client
on:
  push:
    branches: [ "main" ]
  pull_request:
    branches: [ "main" ]
  schedule:
    - cron: '0 16 * * *'
jobs:
  build:
    runs-on: ubuntu-latest
    steps:   
    - name: setup timezone
      uses: zcong1993/setup-timezone@master
      with:
        timezone: Asia/Shanghai    
    - name: checkout
      uses: actions/checkout@v4
    - name: set
      uses: actions/setup-python@v5
      with:
        python-version: ">=3.12"
        cache: 'pip'
        cache-dependency-path: |
              **/requirements*.txt        
    - name: install
      run: |
        pip install -r batch/requirements.txt
    - name: run
      run: |
          python batch/batch.py
```

--------------------------------

### Install K3s Server with Chinese Mirror

Source: https://notebook-atpp.onrender.com/docker/index

Installs K3s, a lightweight Kubernetes distribution, using a script. It configures K3s to use a Chinese mirror for faster downloads and initializes it as a server with Traefik disabled.

```bash
curl -sfL https://rancher-mirror.rancher.cn/k3s/k3s-install.sh | INSTALL_K3S_MIRROR=cn sh -s - server  --cluster-init --disable traefik
```

--------------------------------

### Harbor Installation with Trivy and Notary

Source: https://notebook-atpp.onrender.com/docker/index

Command to install Harbor, an enterprise-grade container registry, with integrated support for Trivy vulnerability scanning and Notary for image signing. Ensure you have a 'install.sh' script available in your current directory.

```bash
./install.sh --with-notary --with-trivy
```

--------------------------------

### iredis CLI Usage Example

Source: https://notebook-atpp.onrender.com/redis/index

This example shows how to connect to a Redis instance using the iredis command-line interface. It includes options for specifying the host, port, password, and customizing the client's appearance and prompt.

```bash
iredis -h xxx -p 6379 -a 'xxx'  --rainbow --newbie --client_name 'test' --iredisrc '/dev/null' --prompt '{client_name} {client_addr} {host}:{port}[{db}]>'
```

--------------------------------

### Start Kubernetes Proxy

Source: https://notebook-atpp.onrender.com/docker/index

Starts the Kubernetes API proxy, allowing access to the Kubernetes API from outside the cluster. It's configured to listen on all interfaces and accept all hosts, and runs in the background.

```bash
kubectl proxy  --port=8888  --address='0.0.0.0'  --accept-hosts='^.*'   >/dev/null 2>&1&
```

--------------------------------

### Installing Virtual Environment Tools

Source: https://notebook-atpp.onrender.com/python/index

Installs the 'virtualenv' package and 'virtualenvwrapper', which are tools for creating and managing isolated Python environments.

```bash
pip install virtualenv
pip install --no-cache-dir virtualenvwrapper
```

--------------------------------

### Install and Run Ollama

Source: https://notebook-atpp.onrender.com/ai/index

This snippet shows how to install Ollama using a curl script and then run it as a server. It also demonstrates how to pull and run a specific model. Environment variables for Ollama configuration are also listed.

```bash
curl -fsSL https://ollama.com/install.sh | sh

ollama serve

ollama run deepseek-r1:1.5b

# Environment variables
# OLLAMA_MODELS 
# OLLAMA_HOST 
# OLLAMA_ORIGINS *
# OLLAMA_KEEP_ALIVE 0
```

--------------------------------

### Starting an FTP Server with pyftpdlib

Source: https://notebook-atpp.onrender.com/python/index

Starts an FTP server using the `pyftpdlib` library. It specifies the port (2121), enables anonymous access, sets a username ('admin'), password ('admin'), and the directory to serve ('.').

```bash
python  -m pyftpdlib -p 2121 -w -u admin -P admin -d .
```

--------------------------------

### Install Metrics Server

Source: https://notebook-atpp.onrender.com/docker/index

Applies the Kubernetes metrics-server components to the cluster. Metrics Server collects resource metrics from Kubelets and exposes them via the Kubernetes API, enabling tools like `kubectl top`.

```bash
kubectl apply -f https://github.com/kubernetes-sigs/metrics-server/releases/download/v0.6.2/components.yaml
```

--------------------------------

### Install and Use mkcert

Source: https://notebook-atpp.onrender.com/web/index

mkcert is a tool for making locally trusted development certificates. This snippet shows commands for installing mkcert, viewing its help information, finding the certificate authority root directory, and generating certificates for local hostnames.

```bash
mkcert.exe --install

mkcert.exe --help

mkcert.exe -CAROOT

mkcert.exe localhost 127.0.0.1 ::1 192.168.1.1
```

--------------------------------

### Set Nginx Variable

Source: https://notebook-atpp.onrender.com/nginx/index

Demonstrates how to set a variable within Nginx configuration. This is useful for defining custom variables that can be used elsewhere in the configuration.

```nginx
server->	set $variable value;
```

--------------------------------

### DuckDB Python Example: Querying Parquet Files

Source: https://notebook-atpp.onrender.com/duckdb/index

This Python script demonstrates how to use DuckDB to connect to a database, query a Parquet file for IP address counts, and log the results. It sets up logging and temporary directories, then executes a SQL query to group and count IP addresses from a specified Parquet file. The example also includes commented-out code for interacting with MySQL databases.

```python
#!/usr/bin/env python
# -*- coding:utf-8 -*-
import logging
from pathlib import Path
import tempfile
import duckdb


logging.basicConfig(
    level=logging.DEBUG,
    format="%(asctime)s - %(name)s - %(levelname)s - %(filename)s:%(lineno)d - %(message)s",
    datefmt="%H:%M:%S",
)
logger = logging.getLogger(__name__)
temp_directory = tempfile.gettempdir()

base_path = str(Path(temp_directory) / "duckdb")
if not Path(base_path).exists():
    Path(base_path).mkdir(parents=True, exist_ok=True)

conn = duckdb.connect()

df = duckdb.sql(
    f"SELECT ip,count(ip) FROM '{str(Path(base_path)/'request_log.parquet')}'  group by ip order by count(ip) desc"
)
logger.info(df)
# duckdb.install_extension ("mysql")
# duckdb.load_extension ("mysql")
HOST = ""
USER = ""
PORT = 3306
DATABASE = ""
PASSWORD = ""
ALIAS = "mysqldb"
# with duckdb.connect() as conn:
#     conn.install_extension ("mysql")
#     conn.load_extension ("mysql")
#     conn.sql ("CALL mysql_clear_cache();")
#     conn.sql(
#         f" ATTACH 'host={HOST} user={USER} port={PORT} database={DATABASE} password={PASSWORD}' AS {ALIAS} (TYPE mysql, READ_ONLY);"
#     )
#     conn.sql(f" use {ALIAS} ;")

#     rows = conn.sql("SHOW TABLES").fetchall()
#     logger.info(rows)
#     for row in rows:
#         table_name = row[0]
#         logger.info(table_name)
#         conn.sql(
#             f"COPY {ALIAS}.{table_name} TO '{str(Path(base_path)/table_name)}.parquet';"
#         )

```

--------------------------------

### Get Kubernetes Services with Wide Output

Source: https://notebook-atpp.onrender.com/docker/index

Retrieves a list of Kubernetes services with additional details such as the selector and endpoint.

```bash
kubectl get svc xxxxx -o wide
```

--------------------------------

### Get Resource Usage of Kubernetes Pods

Source: https://notebook-atpp.onrender.com/docker/index

Displays the current CPU and memory usage of Kubernetes pods. Requires the metrics-server to be installed.

```bash
kubectl top pod
```

--------------------------------

### Mermaid Flowchart Example

Source: https://notebook-atpp.onrender.com/tools/index

This is a Mermaid code snippet that defines a simple flowchart. It illustrates the basic syntax for defining nodes (start, end, operation, condition) and linking them to represent a process flow.

```mermaid
flowchat
st=>start: 开始
e=>end: 结束
op=>operation: 我的操作
cond=>condition: 确认？
st->op->cond
cond(yes)->e
cond(no)->op
```

--------------------------------

### Downloading and Installing Pip with Curl

Source: https://notebook-atpp.onrender.com/python/index

Downloads the get-pip.py script using curl and saves it locally. This script is used to install or upgrade pip, the package installer for Python.

```bash
curl https://bootstrap.pypa.io/get-pip.py -o get-pip.py
```

--------------------------------

### SCP Command Example for Directory Transfer

Source: https://notebook-atpp.onrender.com/shell/index

An example of using `scp` to recursively copy files and directories from the current location to a remote host. It includes preserving attributes and using a specific port if necessary (though not shown in this specific example).

```shell
scp -rp ./.* ./* root@xxxx:~/xx/
```

--------------------------------

### Find files starting from a specific depth

Source: https://notebook-atpp.onrender.com/tools/index

Limits the search to start from a specified directory depth. This prevents searching too deep into the directory structure.

```bash
find /etc -mindepth 3
```

--------------------------------

### Spring Boot Custom Starter Development Steps

Source: https://notebook-atpp.onrender.com/java/index

Outlines the key steps involved in developing a custom Spring Boot starter. This process typically includes creating a service component, defining properties for configuration, setting up an auto-configuration class, and configuring the `spring.factories` file. The starter is then made available by introducing its package in the POM file.

```java
1.创建Service 2.创建Properties 3.创建Autoonfiguration文件 // [!code focus] 4.配置spring.factories文件 5.pom引入package
```

--------------------------------

### Podman Machine Export, Unregister, and Import (WSL)

Source: https://notebook-atpp.onrender.com/docker/index

Demonstrates managing a Podman machine within WSL. It includes exporting the current machine state to a tar archive, unregistering the machine, and then importing it back from the archive, potentially to a new location or with updated configurations.

```bash
wsl --export podman-machine-default D:\docker\podman-machine-default.tar
wsl --unregister podman-machine-default
wsl --import podman-machine-default D:\docker\ D:\docker\podman-machine-default.tar --version 2
```

--------------------------------

### Docker Image Management for Alibaba Cloud Registry

Source: https://notebook-atpp.onrender.com/docker/index

Commands to log in to Alibaba Cloud's container registry, tag a local Docker image, and push it to the registry. Replace placeholders like [ImageId] and [镜像版本号] with your specific values.

```bash
docker login --username=wxw_****@163.com registry.cn-beijing.aliyuncs.com
docker tag [ImageId] registry.cn-beijing.aliyuncs.com/wxw-plus/w1106:[镜像版本号]
docker push registry.cn-beijing.aliyuncs.com/wxw-plus/w1106:[镜像版本号]
```

--------------------------------

### Installing Project Dependencies from requirements.txt

Source: https://notebook-atpp.onrender.com/python/index

Installs all the packages listed in the requirements.txt file into the current Python environment. The '--no-cache-dir' flag prevents pip from using its cache, ensuring fresh downloads.

```bash
pip install --no-cache-dir -U -r .\requirements.txt
```

--------------------------------

### Initialize Kubernetes Control Plane (kubeadm)

Source: https://notebook-atpp.onrender.com/docker/index

Initializes the Kubernetes control plane using kubeadm. It allows specifying an alternative image repository and ignoring preflight checks for flexibility during setup. Multiple command variations are provided for different configurations.

```bash
kubeadm reset

kubeadm init --image-repository registry.aliyuncs.com/google_containers --ignore-preflight-errors=all --v=5 --kubernetes-version v1.27.4
```

```bash
kubeadm init \
--apiserver-advertise-address=192.168.31.133  \
--image-repository registry.aliyuncs.com/google_containers \
--kubernetes-version v1.22.2 \
--service-cidr=10.96.0.0/12 \
--pod-network-cidr=10.244.0.0/16 \
--ignore-preflight-errors=all
```

```bash
kubeadm config images pull --image-repository registry.aliyuncs.com/google_containers
```

```bash
kubeadm init --apiserver-advertise-address $(hostname -i) --pod-network-cidr 10.5.0.0/16
```

--------------------------------

### List Available Kubernetes Images (kubeadm)

Source: https://notebook-atpp.onrender.com/docker/index

Lists the container images required for the current Kubernetes version. This helps in pre-pulling images or understanding dependencies.

```bash
kubeadm config image list
```

--------------------------------

### Java Application Execution with JVM Arguments

Source: https://notebook-atpp.onrender.com/java/index

Demonstrates how to execute a Java application using `java -jar` and how to correctly place JVM arguments (prefixed with `-D`) before the `-jar` option. It also shows an example with multiple JVM arguments for configuring Spring Boot, Redis, MySQL, and other settings.

```bash
【-D】要放到  -jar 前面，否则参数无效

java   -jar xxxx --spring.profiles.active=dev --server.port=8085  --springfox.documentation.auto-startup=false --spring.jmx.enabled=false --spring.jpa.properties.hibernate.temp.use_jdbc_metadata_defaults=false --spring.devtools.add-properties=false --mybatis.configuration.log-impl=org.apache.ibatis.logging.nologging.NoLoggingImpl --logging.level.com.app286=info --server.compression.enabled=true --server.compression.mime-types=application/javascript,text/css,application/json,application/xml,text/html,text/xml,text/plain --server.compression.min-response-size=128


java -jar "-XX:+UseConcMarkSweepGC -Dspring.redis.host=127.0.0.1 -Dspring.redis.port=6379 -Dspring.redis.password=root -Dspring.redis.database=0 -Dspring.datasource.url=jdbc:mysql://127.0.0.1:3306/xxx?userUnicode=true&characterEncoding=UTF-8&useSSL=false&serverTimezone=Asia/Shanghai&&allowPublicKeyRetrieval=true -Dspring.datasource.username=root -Dspring.datasource.password=123456" xxx.war
```

--------------------------------

### Create and Query Relationships in CQL

Source: https://notebook-atpp.onrender.com/neo4j/index

Demonstrates creating nodes (Line, Station) and establishing relationships between them (has, next). It also shows how to query all relationships and specific node-to-node paths.

```cql
create (n:Line {name:'1号线'}) return n;
create (n:Station {name:'古城' }) return n;
create (n:Station {name:'石景山' }) return n;
match (l:Line {name:'1号线'}), (s:Station {name:'古城'}) MERGE (l)-[:`has`]->(s);
match (l:Line {name:'1号线'}), (s:Station {name:'石景山'}) MERGE (l)-[:`has`]->(s);

match (s1:Station {name:'石景山'}), (s2:Station {name:'古城'}) MERGE (s1)-[:`next`{dist:10}]->(s2);
match (s2:Station {name:'古城'}),(s1:Station {name:'石景山'})   MERGE (s2)-[:`next`{dist:10}]->(s1);

MATCH p=()-[r]->() RETURN *;

MATCH (n)-->() RETURN n

 MATCH (n:Station { name: '东单' })-[:next|has]->() RETURN n
 MATCH (n:Station { name: '东单' })-[r]->() RETURN n,r


 MATCH (n:Station)-[{line_no:"1号线"}]->() 
 RETURN n


match (n:Line{name:"1号线"})-[r]->(m)-[k]->(v) return n,r,m,k,v

MATCH (s1:`Station` {name:"东单"}),(s2:`Station` {name:"古城"}),
p=shortestpath((s1)-[r]->(s2))
RETURN p

match p = shortestpath((:Station{name:"东单"})-[*..3]-(:Station{name:"古城"})) return p

MATCH (s1:`Station` {name:"顺义"}),(s2:`Station` {name:"燕山"}),
p=shortestpath((s1)-[r:`next`*..]->(s2))
RETURN p

MATCH n= (s1:`Station` {name:"东单"}),(s2:`Station` {name:"古城"}),
p=shortestpath((s1)-[r:next*..]-(s2))
RETURN p,length(p)

 MATCH n=(:Station { name: '东单' })-[r:next|has]-() RETURN n,length(n),sum(r.dist)

```

--------------------------------

### Basic Git Initialization and Pushing

Source: https://notebook-atpp.onrender.com/git/index

Initializes a new Git repository, adds all files, commits them with a message, adds a remote origin, and pushes to the master branch.

```bash
git init
git add .
git commit -m "xxxx"
git remote add origin xxxx.git
git push -u origin master
```

```bash
git init --initial-branch=main
git remote add origin xxxx.git
git add .
git commit -m "Initial commit"
git push --set-upstream origin main
```

--------------------------------

### Java Comparator for Null-Safe Sorting

Source: https://notebook-atpp.onrender.com/java/index

Java code snippet using Streams API to sort a list of objects based on a start time, handling potential null values gracefully. `Comparator.nullsLast(Date::compareTo)` ensures that null start times are placed at the end of the sorted list.

```java
       finalDataList.stream().sorted(Comparator.comparing(XXX::getStartTime, Comparator.nullsLast(Date::compareTo))).collect(Collectors.toList());
```

--------------------------------

### Describe Kubernetes Pod Details

Source: https://notebook-atpp.onrender.com/docker/index

Provides detailed information about a specific Kubernetes pod, including its status, events, and configuration.

```bash
kubectl describe pod xxx
```

--------------------------------

### Get Kubernetes Events

Source: https://notebook-atpp.onrender.com/docker/index

Retrieves a list of recent events in the Kubernetes cluster. This is useful for troubleshooting.

```bash
kubectl get events
```

--------------------------------

### CQL Syntax Explanation

Source: https://notebook-atpp.onrender.com/neo4j/index

Provides a brief explanation of key Cypher syntax elements used for representing graph data structures.

```cql
() 表示节点
[] 表示关系
{} 表示属性
> 表示关系的方向
```

--------------------------------

### Get Kubernetes Pods with Wide Output

Source: https://notebook-atpp.onrender.com/docker/index

Retrieves a list of pods with additional information such as the node they are running on and their IP addresses.

```bash
kubectl get pods xxx -o wide
```

--------------------------------

### Get Kubernetes Dashboard Token

Source: https://notebook-atpp.onrender.com/docker/index

Retrieves the authentication token for the Kubernetes dashboard service account. This token can be used to log in to the dashboard.

```bash
kubectl -n kubernetes-dashboard create token kubernetes-dashboard
```

--------------------------------

### Maven and Java Application Execution

Source: https://notebook-atpp.onrender.com/java/index

Provides a command-line example for building a Java application using Maven with parallel compilation and skipping tests, followed by executing the generated JAR file with specific Spring profiles and server port.

```bash
mvn clean package -T 1C -DskipTests '-Dmaven.compile.fork=true'&&java -jar xxxx.jar --spring.profiles.active=dev --server.port=8085
```
Tokens:
Raw