The AI-native framework for building data portals.
Describe the portal you want β your agent helps you choose an architecture, scaffolds it, and loads your data.
Docs
Β·
Discussions
Β·
Report a bug
Create a portal β one command, nothing to install beyond Node 18+:
npm create portaljs@latest my-portal
cd my-portal
npm run dev # β http://localhost:3000You get the three surfaces β Home, a Catalog (/search), and a dataset Showcase
(/@<namespace>/<slug>) β over sample data. Plain, editable Next.js, no lock-in. Add your
own CSV/JSON to datasets.json and it renders automatically.
Build it with your AI assistant β PortalJS ships Claude Code
skills that do the assembly. Install them once (into ~/.claude/commands):
curl -fsSL https://raw.githubusercontent.com/datopian/portaljs/main/scripts/install-portaljs-skills.sh | bashThen, in a Claude Code session from any directory:
/portaljs-architect not sure what stack you need? start here
/portaljs-new-portal "Auckland Council open data portal"
/portaljs-add-dataset ./data/air-quality.csv
/portaljs-new-portal scaffolds the three surfaces; /portaljs-add-dataset (or /portaljs-add-resource) loads data;
/portaljs-connect-ckan points it at a CKAN backend; /portaljs-deploy ships it. (All skills + install β)
Prefer the bare template β plain Next.js, no AI, no lock-in:
npx tiged datopian/portaljs/examples/portaljs-catalog my-portal
cd my-portal && npm install && npm run dev # β http://localhost:3000You get Home, a Catalog (/search), and a dataset Showcase (/@<namespace>/<slug>) over
sample data. Add your own CSV/JSON to datasets.json and it renders automatically.
β If it's useful, a star helps others find it.
Building a data portal has always meant more than a website. You have to decide where the data lives, how it's versioned, how people search it, how it's served, and how it's governed β and then wire a frontend on top. Teams either over-build on a heavy data warehouse they don't need, or under-build on a pile of scripts that doesn't scale.
PortalJS is an open-source, agentic skills framework that helps data teams build, develop, and ship data portals β and the data infrastructure underneath them. It isn't only a frontend. The skills do two jobs:
- Advise β given what you're building, what your data is, and what it's for, they recommend an architecture: storage, compute, catalog, access, hosting, metadata.
- Build β they scaffold that stack as plain, editable Next.js code with no lock-in.
It is opinionated but open: the recommended modern path is git + object storage (Cloudflare R2) + Parquet, queried with DuckDB β an open lakehouse instead of a classic warehouse. For living, incremental tables you can layer on DuckLake, and a traditional datastore (CKAN, a warehouse) stays a first-class option when you need it. You always own plain code.
Built and maintained in the open by Datopian and the PortalJS community.
π§ you describe what you want to build
β
βΌ
ββ π€ AGENTIC SKILLS ββββββββββββββββββββββββββββββββββ decide + build
β /portaljs-architect Β· /portaljs-new-portal Β· /portaljs-add-dataset Β· /portaljs-add-chart Β· /portaljs-add-map β¦
β°β generates plain, editable Next.js code β no lock-in
β
βΌ
ββ π₯οΈ SURFACES ββββββββββββββββββββββββββββββββββββββββ what users see
β π Home / π Catalog /search π Showcase /@ns/slug
β°β read data through one DataProvider contract
β
βΌ
ββ π PROVIDERS βββββββββββββββββββββββββββββββββββββββ pluggable backends
β π staticΒ·git π CKAN π OpenMetadata ποΈ git-LFS + R2
β°β swap the source without touching a page
β
βΌ
π¦ STORAGE + COMPUTE β choose your point on the spectrum:
flat files ββΆ Git-LFS + R2 ββΆ Parquet on R2 + π¦ DuckDB ββΆ warehouse / CKAN
simplest β open lakehouse (default) heaviest
(+ DuckLake for living tables)
βοΈ Substrate β Cloudflare R2 (storage) Β· Workers (runtime) Β· D1 (catalog) Β· Pages (static)
object storage stays S3-compatible β R2 is the default, never a lock-in
Three surfaces. Every data portal is built from three: a Home page that explains
it and offers search, a Catalog (/search) to discover datasets, and a Showcase
(/@<namespace>/<slug>) to explore one dataset β metadata, preview, download/API, and
charts/maps. (Core concepts β)
One seam. The surfaces read data only through a DataProvider, so the source β static
files today, a CKAN or lakehouse backend tomorrow β can change without touching a page.
See ROADMAP.md for the full model and the
architecture decision framework
for how /portaljs-architect turns your needs into a stack.
PortalJS ships Claude Code skills that turn a brief into a working portal.
Install the skills once into your personal scope so they're available from any directory:
curl -fsSL https://raw.githubusercontent.com/datopian/portaljs/main/scripts/install-portaljs-skills.sh | bashRestart Claude Code (or open a new session) and type / to see them. See
.claude/INSTALL.md for other install options (versioned plugin, or
running straight from a clone of this repo).
If you're not sure how to set up your portal, start with the advisor, then build:
/portaljs-architect we have ~200 public CSVs, updated quarterly, and must publish DCAT-AP
/portaljs-new-portal "Auckland Council open data portal"
/portaljs-add-dataset ./data/air-quality.csv
/portaljs-add-dataset https://example.com/parks.geojson
The skills are interactive β if your brief is thin, they interview you in short rounds
rather than erroring. /portaljs-architect recommends a stack and hands off; /portaljs-new-portal
scaffolds the three surfaces; /portaljs-add-dataset appends to the datasets.json manifest and
the showcase renders automatically at /@<namespace>/<slug>. Run npm run dev and you
have a portal.
Prefer to build by hand? The skills are a convenience, not a requirement β scaffold the template directly with the CLI:
npm create portaljs@latest my-portal(Or grab the bare template with no prompts: npx tiged datopian/portaljs/examples/portaljs-catalog my-portal.)
| Skill | What it does |
|---|---|
/portaljs-architect |
Advisory β turns your needs (data, scale, governance) into a recommended architecture before you build. Start here if you're unsure of the stack. |
/portaljs-new-portal |
Scaffold a new portal (Home + Catalog + Showcase) from a brief β copies the template, substitutes your project name and description, installs deps, verifies the build. |
/portaljs-add-dataset |
Add a CSV, TSV, JSON, or GeoJSON dataset β registers it in the catalog and renders its showcase automatically; large local files are pushed to Cloudflare R2 via Git LFS for you. |
/portaljs-add-resource |
Attach another file (data dictionary, methodology, extra data) to an existing dataset β it becomes multi-resource and the showcase renders a section per file. |
/portaljs-add-chart |
Add a line, bar, area, pie, or scatter chart to a dataset's showcase. |
/portaljs-add-map |
Render a GeoJSON dataset on an interactive map and register it on the home page. |
/portaljs-define-schema |
Infer a Frictionless Table Schema from a dataset's data, add license/source/keyword metadata, and surface a typed field table on its showcase. |
/portaljs-connect-ckan |
Wire the portal to a CKAN backend over its API instead of static files. |
/portaljs-check-data-quality |
Validate a dataset against its schema and flag quality issues (type mismatches, missing values, constraint violations). |
/portaljs-migrate |
Harvest or migrate a whole catalog into the portal from CKAN, Socrata, OpenDataSoft, ArcGIS, or DCAT-US, over a canonical Frictionless/DCAT model. |
/portaljs-deploy |
Build a static export and publish it to PortalJS Arc β Datopian-managed hosting on Cloudflare β with a live <slug>.arc.portaljs.com URL. |
Large-data scaling β big files pushed to Cloudflare R2 via Git LFS β already ships in
/portaljs-add-dataset. More skill families β metadata schemas (Frictionless/DCAT), more
backends (OpenMetadata), a browser DuckDB query layer, and access control β are on the
roadmap. Write your own β see .claude/AUTHORING.md.
.claude/commands/ the agentic skills (slash commands)
examples/ reference portals β portaljs-catalog is the canonical template
packages/
core/ layout/UI components (@portaljs/core)
ckan/ CKAN catalog UI + React (@portaljs/ckan)
ckan-api-client-js/ pure CKAN API client (@portaljs/ckan-api-client-js)
site/ portaljs.com β the marketing site + docs
ROADMAP.md direction, the four contracts, sequencing
The canonical template, examples/portaljs-catalog, is where
the three surfaces and the DataProvider seam live β read it before building.
- π± Open source, MIT, no lock-in β every skill emits plain Next.js you can fork and own.
- π§ Advisory, not just generative β
/portaljs-architecthelps you decide the infrastructure, not only scaffold a UI. - π¦ Open lakehouse by default β git + R2 + Parquet queried with DuckDB, over a heavy warehouse; add DuckLake for living/incremental tables. A datastore/warehouse stays a supported choice.
- βοΈ Cloudflare-first, portable β R2 / Workers / D1 / Pages as the default substrate, but object storage stays S3-compatible.
- π§© Decoupled, any backend β one
DataProvidercontract in front of CKAN, DKAN, OpenMetadata, DataHub, GitHub, Frictionless, plain files β or your own. - π¨ Bring your own stack β adopt the template or lift the skills and the three-surface model into an app you already have.
Reference implementations live in examples/:
| Example | Backend |
|---|---|
portaljs-catalog |
Canonical template β Home + Catalog + Showcase over a static manifest |
portaljs-template |
Minimal single-page starter |
ckan Β· ckan-ssg |
CKAN |
github-backed-catalog |
GitHub |
dataset-frictionless |
Frictionless Data Package |
fivethirtyeight Β· openspending Β· turing |
Real-world portals |
- π¬ Discord β live chat and help: join the server
- π£οΈ Discussions β questions, ideas, show-and-tell: github.com/datopian/portaljs/discussions
- π Issues β bugs and feature requests: open an issue
- π Docs β portaljs.com/docs
PortalJS is built in the open and we welcome contributions of all sizes β new skills, examples, docs, and fixes. See CONTRIBUTING.md to get started, and read ROADMAP.md and VISION.md for where the project is headed.