1

S3 Table Bucket Commands

Chris Lu edited this page 2026-01-30 11:33:33 -08:00

Table of Contents

• Configuration
• Prerequisites
• 1. Table Bucket Operations
• Create Table Bucket
• List Table Buckets
• Get Table Bucket
• 2. Namespace Operations
• Create Namespace
• List Namespaces
• 3. Table Operations
• Create Table (Iceberg)
• List Tables
• 4. Policy and Tagging
• Put Table Bucket Policy
• Get Table Bucket Policy
• Tag Resource
• List Tags
• Cleanup
• Delete Table
• Delete Namespace
• Delete Table Bucket

SeaweedFS supports the S3 Tables API, providing a way to manage table-based data structures with AWS S3 compatibility. This guide provides commands to test the S3 Tables features in SeaweedFS.

Configuration

Prerequisites

For AWS CLI and curl commands, configure your environment variables:

export S3_ENDPOINT=http://localhost:8333
export AWS_ACCESS_KEY_ID=any
export AWS_SECRET_ACCESS_KEY=any
export AWS_DEFAULT_REGION=us-east-1

Note

The s3tables service is a relatively new AWS service. Ensure your AWS CLI is up to date (v2.17+ recommended). If aws s3tables is not available, use the curl commands provided below.

---

1. Table Bucket Operations

Create Table Bucket

AWS CLI:

aws s3tables create-table-bucket --endpoint-url $S3_ENDPOINT --name my-test-bucket

curl:

curl -X POST $S3_ENDPOINT/ \
  -H "X-Amz-Target: S3Tables.CreateTableBucket" \
  -H "Content-Type: application/x-amz-json-1.1" \
  -d '{"name": "my-test-bucket"}'

---

List Table Buckets

AWS CLI:

aws s3tables list-table-buckets --endpoint-url $S3_ENDPOINT

curl:

curl -X POST $S3_ENDPOINT/ \
  -H "X-Amz-Target: S3Tables.ListTableBuckets" \
  -H "Content-Type: application/x-amz-json-1.1" \
  -d '{}'

---

Get Table Bucket

AWS CLI:

aws s3tables get-table-bucket --endpoint-url $S3_ENDPOINT --table-bucket-arn arn:aws:s3tables:us-east-1:000000000000:bucket/my-test-bucket

curl:

curl -X POST $S3_ENDPOINT/ \
  -H "X-Amz-Target: S3Tables.GetTableBucket" \
  -H "Content-Type: application/x-amz-json-1.1" \
  -d '{"tableBucketARN": "arn:aws:s3tables:us-east-1:000000000000:bucket/my-test-bucket"}'

---

2. Namespace Operations

Create Namespace

AWS CLI:

aws s3tables create-namespace --endpoint-url $S3_ENDPOINT --table-bucket-arn arn:aws:s3tables:us-east-1:000000000000:bucket/my-test-bucket --namespace my_namespace

curl:

curl -X POST $S3_ENDPOINT/ \
  -H "X-Amz-Target: S3Tables.CreateNamespace" \
  -H "Content-Type: application/x-amz-json-1.1" \
  -d '{
    "tableBucketARN": "arn:aws:s3tables:us-east-1:000000000000:bucket/my-test-bucket",
    "namespace": ["my_namespace"]
  }'

---

List Namespaces

AWS CLI:

aws s3tables list-namespaces --endpoint-url $S3_ENDPOINT --table-bucket-arn arn:aws:s3tables:us-east-1:000000000000:bucket/my-test-bucket

curl:

curl -X POST $S3_ENDPOINT/ \
  -H "X-Amz-Target: S3Tables.ListNamespaces" \
  -H "Content-Type: application/x-amz-json-1.1" \
  -d '{"tableBucketARN": "arn:aws:s3tables:us-east-1:000000000000:bucket/my-test-bucket"}'

---

3. Table Operations

Create Table (Iceberg)

AWS CLI:

aws s3tables create-table --endpoint-url $S3_ENDPOINT --table-bucket-arn arn:aws:s3tables:us-east-1:000000000000:bucket/my-test-bucket --namespace my_namespace --name my_table --format ICEBERG

curl:

curl -X POST $S3_ENDPOINT/ \
  -H "X-Amz-Target: S3Tables.CreateTable" \
  -H "Content-Type: application/x-amz-json-1.1" \
  -d '{
    "tableBucketARN": "arn:aws:s3tables:us-east-1:000000000000:bucket/my-test-bucket",
    "namespace": ["my_namespace"],
    "name": "my_table",
    "format": "ICEBERG"
  }'

---

List Tables

AWS CLI:

aws s3tables list-tables --endpoint-url $S3_ENDPOINT --table-bucket-arn arn:aws:s3tables:us-east-1:000000000000:bucket/my-test-bucket --namespace my_namespace

curl:

curl -X POST $S3_ENDPOINT/ \
  -H "X-Amz-Target: S3Tables.ListTables" \
  -H "Content-Type: application/x-amz-json-1.1" \
  -d '{
    "tableBucketARN": "arn:aws:s3tables:us-east-1:000000000000:bucket/my-test-bucket",
    "namespace": ["my_namespace"]
  }'

---

4. Policy and Tagging

Put Table Bucket Policy

AWS CLI:

aws s3tables put-table-bucket-policy --endpoint-url $S3_ENDPOINT \
  --table-bucket-arn arn:aws:s3tables:us-east-1:000000000000:bucket/my-test-bucket \
  --resource-policy "{\"Version\":\"2012-10-17\",\"Statement\":[{\"Effect\":\"Allow\",\"Principal\":\"*\",\"Action\":\"s3tables:*\",\"Resource\":\"*\"}]}"

curl:

curl -X POST $S3_ENDPOINT/ \
  -H "X-Amz-Target: S3Tables.PutTableBucketPolicy" \
  -H "Content-Type: application/x-amz-json-1.1" \
  -d '{
    "tableBucketARN": "arn:aws:s3tables:us-east-1:000000000000:bucket/my-test-bucket",
    "resourcePolicy": "{\"Version\":\"2012-10-17\",\"Statement\":[{\"Effect\":\"Allow\",\"Principal\":\"*\",\"Action\":\"s3tables:*\",\"Resource\":\"*\"}]}"
  }'

Get Table Bucket Policy

AWS CLI:

aws s3tables get-table-bucket-policy --endpoint-url $S3_ENDPOINT \
  --table-bucket-arn arn:aws:s3tables:us-east-1:000000000000:bucket/my-test-bucket

curl:

curl -X POST $S3_ENDPOINT/ \
  -H "X-Amz-Target: S3Tables.GetTableBucketPolicy" \
  -H "Content-Type: application/x-amz-json-1.1" \
  -d '{"tableBucketARN": "arn:aws:s3tables:us-east-1:000000000000:bucket/my-test-bucket"}'

Tag Resource

AWS CLI:

aws s3tables tag-resource --endpoint-url $S3_ENDPOINT \
  --resource-arn arn:aws:s3tables:us-east-1:000000000000:bucket/my-test-bucket \
  --tags Environment=test,Owner=admin

curl:

curl -X POST $S3_ENDPOINT/ \
  -H "X-Amz-Target: S3Tables.TagResource" \
  -H "Content-Type: application/x-amz-json-1.1" \
  -d '{
    "resourceArn": "arn:aws:s3tables:us-east-1:000000000000:bucket/my-test-bucket",
    "tags": {"Environment": "test", "Owner": "admin"}
  }'

List Tags

AWS CLI:

aws s3tables list-tags-for-resource --endpoint-url $S3_ENDPOINT \
  --resource-arn arn:aws:s3tables:us-east-1:000000000000:bucket/my-test-bucket

curl:

curl -X POST $S3_ENDPOINT/ \
  -H "X-Amz-Target: S3Tables.ListTagsForResource" \
  -H "Content-Type: application/x-amz-json-1.1" \
  -d '{"resourceArn": "arn:aws:s3tables:us-east-1:000000000000:bucket/my-test-bucket"}'

---

Cleanup

Delete Table

AWS CLI:

aws s3tables delete-table --endpoint-url $S3_ENDPOINT \
  --table-bucket-arn arn:aws:s3tables:us-east-1:000000000000:bucket/my-test-bucket \
  --namespace my_namespace \
  --name my_table

curl:

curl -X POST $S3_ENDPOINT/ \
  -H "X-Amz-Target: S3Tables.DeleteTable" \
  -H "Content-Type: application/x-amz-json-1.1" \
  -d '{
    "tableBucketARN": "arn:aws:s3tables:us-east-1:000000000000:bucket/my-test-bucket",
    "namespace": ["my_namespace"],
    "name": "my_table"
  }'

Delete Namespace

AWS CLI:

aws s3tables delete-namespace --endpoint-url $S3_ENDPOINT \
  --table-bucket-arn arn:aws:s3tables:us-east-1:000000000000:bucket/my-test-bucket \
  --namespace my_namespace

curl:

curl -X POST $S3_ENDPOINT/ \
  -H "X-Amz-Target: S3Tables.DeleteNamespace" \
  -H "Content-Type: application/x-amz-json-1.1" \
  -d '{
    "tableBucketARN": "arn:aws:s3tables:us-east-1:000000000000:bucket/my-test-bucket",
    "namespace": ["my_namespace"]
  }'

Delete Table Bucket

AWS CLI:

aws s3tables delete-table-bucket --endpoint-url $S3_ENDPOINT \
  --table-bucket-arn arn:aws:s3tables:us-east-1:000000000000:bucket/my-test-bucket

curl:

curl -X POST $S3_ENDPOINT/ \
  -H "X-Amz-Target: S3Tables.DeleteTableBucket" \
  -H "Content-Type: application/x-amz-json-1.1" \
  -d '{"tableBucketARN": "arn:aws:s3tables:us-east-1:000000000000:bucket/my-test-bucket"}'

Introduction

• Quick Start with weed mini
• Components
• Getting Started
• Production Setup
• Benchmarks
• FAQ
• Applications

API

• Master Server API
• Volume Server API
• Filer Server API
• Client Libraries
• SeaweedFS Java Client

Configuration

• Replication
• Store file with a Time To Live
• Failover Master Server
• Erasure coding for warm storage
• Server Startup via Systemd
• Environment Variables

Filer

• Filer Setup
• Directories and Files
• File Operations Quick Reference
• Data Structure for Large Files
• Filer Data Encryption
• Filer Commands and Operations
• Filer JWT Use
• TUS Resumable Uploads

Filer Stores

• Filer Cassandra Setup
• Filer Redis Setup
• Super Large Directories
• Path-Specific Filer Store
• Choosing a Filer Store
• Customize Filer Store

Management

• Admin UI
• Worker

Advanced Filer Configurations

• Migrate to Filer Store
• Add New Filer Store
• Filer Store Replication
• Filer Active Active cross cluster continuous synchronization
• Filer as a Key-Large-Value Store
• Path Specific Configuration
• Filer Change Data Capture

FUSE Mount

• FIO benchmark
• fstab

WebDAV

Cloud Drive

• Cloud Drive Benefits
• Cloud Drive Architecture
• Configure Remote Storage
• Mount Remote Storage
• Cache Remote Storage
• Cloud Drive Quick Setup
• Gateway to Remote Object Storage

AWS S3 API

• Amazon S3 API
• S3 Conditional Operations
• S3 CORS
• S3 Object Lock and Retention
• S3 Object Versioning
• S3 API Benchmark
• S3 API FAQ
• S3 Bucket Quota
• S3 Rate Limiting
• S3 API Audit log
• S3 Nginx Proxy
• Docker Compose for S3

S3 Table Bucket

• S3 Table Bucket

S3 Authentication & IAM

• S3 Configuration - Start Here
• S3 Credentials (-s3.config)
• OIDC Integration (-s3.iam.config)
• S3 Policy Variables
• Amazon IAM API
• AWS IAM CLI

Server-Side Encryption

• Server-Side Encryption
• Server-Side Encryption SSE-KMS
• Server-Side Encryption SSE-C

S3 Client Tools

• AWS CLI with SeaweedFS
• s3cmd with SeaweedFS
• rclone with SeaweedFS
• restic with SeaweedFS
• nodejs with Seaweed S3

Machine Learning

• TensorFlow with SeaweedFS

HDFS

• Hadoop Compatible File System
• run Spark on SeaweedFS
• run HBase on SeaweedFS
• run Presto on SeaweedFS
• Hadoop Benchmark
• HDFS via S3 connector

Replication and Backup

• Async Replication to another Filer [Deprecated]
• Async Backup
• Async Filer Metadata Backup
• Async Replication to Cloud [Deprecated]
• Kubernetes Backups and Recovery with K8up

Metadata Change Events

• Filer Metadata Events
• Filer Notification Webhook

Messaging

• Structured Data Lake with SMQ and SQL
• Seaweed Message Queue
• SQL Queries on Message Queue
• SQL Quick Reference
• PostgreSQL-compatible Server weed db
• Pub-Sub to SMQ to SQL
• Kafka to Kafka Gateway to SMQ to SQL

Use Cases

• Use Cases
• Actual Users

Operations

• System Metrics
• weed shell
• Data Backup
• Deployment to Kubernetes and Minikube

Advanced

• Large File Handling
• Optimization
• Volume Management
• Tiered Storage
• Cloud Tier
• Cloud Monitoring
• Load Command Line Options from a file
• SRV Service Discovery
• Volume Files Structure

Security

• Security Overview
• Security Configuration
• Cryptography and FIPS Compliance
• Run Blob Storage on Public Internet

Misc Use Case Examples

• UrBackup with SeaweedFS
• Docker Image Registry with SeaweedFS
• SeaweedFS in Docker Swarm
• Words from SeaweedFS Users
• Independent Benchmarks
• Hardware