Introducing The ASF’s New Logo Read Now

Board history: StormCrawler

ASF Oak Leaf Icon

StormCrawler

What the board has decided about this committee or office, and the reports it filed, most recent first. Generated from the published minutes.

These categorised views are best effort. They are read from the published minutes by a program, and what it can attribute to a committee depends on how each resolution happens to be worded — so a page may be incomplete, and nothing here overrides the minutes themselves. The raw minutes are the source of truth.

Please note. The board approves the minutes of a meeting at the meeting after it, and they are published then - so the most recent meeting is not usually here. ASF Members can read the draft in the board's own repository until it is.

[raw] the published minutes, which are the record. [main index]

Appointments

Date Action Decided by
2025-05-21 Appointed Richard Zowalla the board, by resolution

Decisions

Date Decision Item Outcome
2025-05-21 Establish the Apache StormCrawler Project special order approved

Reports

2026-08-19 — Richard Zowalla

## Description:
The mission of Apache StormCrawler is the creation and maintenance of software
related to an open source collection of resources for building low-latency,
scalable web crawlers on Apache Storm.

## Project Status:
Current project status: Active
Issues for the board: None

## Membership Data:
Apache StormCrawler was founded 2025-05-21 (a year ago)
There are currently 12 committers and 6 PMC members in this project.
The Committer-to-PMC ratio is 2:1.

Community changes, past quarter:
- No new PMC members. Last addition was Dávid Szigecsán on 2026-03-03.
- Davide Polato was added as committer on 2026-05-11.

## Project Activity:
External contributions continue to arrive at a steady pace. A new release
manager has stepped up and is currently working on getting the next release
out. In parallel, discussions around StormCrawler 4.0.0 are underway, with
the current proposal targeting Apache Storm 3.0.0 as the baseline and moving
to Java 25 in order to take advantage of virtual threads.

Recent releases:
stormcrawler-3.7.0 was released on 2026-08-01.
stormcrawler-3.6.0 was released on 2026-05-26.
stormcrawler-3.5.1 was released on 2026-01-25.

## Community Health:
The StormCrawler community remains active and stable. External contributions
continue to arrive, and the addition of Davide Polato as a new committer
during the quarter is a positive signal of community growth. He also stepped
up as  release manager and prepared his first StormCrawler release. Early
discussions around a 4.0.0 release, including a modernized baseline on Storm
3.0.0 and Java 25, indicate healthy forward planning within the community.

2026-05-20 — Richard Zowalla

## Description:
The mission of Apache StormCrawler is the creation and maintenance of software
related to an open source collection of resources for building low-latency,
scalable web crawlers on Apache Storm

## Project Status:
Current project status: Active
Issues for the board: None

## Membership Data:
Apache StormCrawler was founded 2025-05-21 (a year ago)
There are currently 11 committers and 6 PMC members in this project.
The Committer-to-PMC ratio is roughly 2:1.

Community changes, past quarter:
- Dávid Szigecsán was added to the PMC on 2026-03-03
- No new committers. Last addition was Dávid Szigecsán on 2025-09-23.

A new committer candidate is currently under vote.

## Project Activity:
Contributions from external participants continue to arrive, including from
first-time contributors. We are also seeing encouraging traffic on the
revamped documentation site introduced with the most recent release, which
suggests the improved structure and accessibility are helping users find what
they need. We hope this will continue to lower the barrier to entry and bring
more contributors into the project over time.

On the trademark front, we have finalized a logo for the project following
feedback from M&P. With the logo now in place, we plan to move forward with
the remaining steps of the trademark process.

Recent releases:
stormcrawler-3.5.1 was released on 2026-01-25.
stormcrawler-3.5.0 was released on 2025-09-16.
stormcrawler-3.4.0 was released on 2025-06-27.

## Community Health:
The StormCrawler community remains active and stable. Pull requests from
external contributors continue to arrive, and engagement with the new
documentation is a positive signal for community growth. Since the last
report, we have added a new PMC member, bringing the PMC to six, which
partially addresses the concern raised previously about the small size of the
PMC and the difficulty of gathering votes within short timeframes. Discussion
of an additional committer is underway on the private list, which would
further strengthen the contributor base. Ongoing documentation improvements
remain a focus to ensure newcomers can participate easily and existing
contributors stay engaged.

2026-02-18 — Richard Zowalla

## Description:
The mission of Apache StormCrawler is the creation and maintenance of software
related to an open source collection of resources for building low-latency,
scalable web crawlers on Apache Storm

## Project Status:
Current project status: Active
Issues for the board: None

## Membership Data:
Apache StormCrawler was founded 2025-05-21 (8 months ago)
There are currently 11 committers and 5 PMC members in this project.
The Committer-to-PMC ratio is roughly 2:1.

Community changes, past quarter:
- No new PMC members.
- No new committers. Last addition was Dávid Szigecsán on 2025-09-23.

## Project Activity:
Contributions from external participants continue to arrive. With
the most recent release, we have enhanced our documentation, making it more
comprehensive and accessible. We hope that these improvements will not only
provide better guidance for existing users but also encourage new users and
contributors to explore, engage with, and contribute to the project.
Trademark-related initiatives are still in the early planning stages. We are
currently evaluating a new logo and have already received feedback from M&P.
Based on this input, we hope to finalize a strong candidate and move forward
with the trademark process in the near future.

Recent releases:
stormcrawler-3.5.1 was released on 2026-01-25.
stormcrawler-3.5.0 was released on 2025-09-16.
stormcrawler-3.4.0 was released on 2025-06-27.

## Community Health:
The StormCrawler community remains active and stable. We continue to receive
pull requests from external contributors, including first-time participants.
Our ongoing efforts to improve documentation are designed to lower the barrier
to entry, making it easier for newcomers to participate and for existing
contributors to stay engaged. Additionally, there is a need to expand our PMC,
which currently consists of only five members. With a small PMC, it can
sometimes be challenging to gather enough votes in a short timeframe,
particularly during holiday periods or when members are temporarily
unavailable.

2025-11-19 — Richard Zowalla

## Description:
The mission of Apache StormCrawler is the creation and maintenance of software
related to an open source collection of resources for building low-latency,
scalable web crawlers on Apache Storm

## Project Status:
Current project status: Active
Issues for the board: None

## Membership Data:
Apache StormCrawler was founded 2025-05-21 (5 months ago)
There are currently 11 committers and 5 PMC members in this project.
The Committer-to-PMC ratio is roughly 2:1.

Community changes, past quarter:
- No new PMC members.
- Dávid Szigecsán was added as committer on 2025-09-23

## Project Activity:
Outside contributions continue to arrive regularly, demonstrating interest and
participation from the broader community. We’re pleased to have added a new
committer, which further strengthens our core team. In addition,
we’ve established our security model to ensure clearer processes for handling
potential vulnerabilities with the ASF security team.
Trademark-related tasks remain in the early planning stages.

Recent releases:
stormcrawler-3.5.0 was released on 2025-09-16.
stormcrawler-3.4.0 was released on 2025-06-27.

## Community Health:
The StormCrawler community remains active and stable. We continue to receive
pull requests from external contributors and first-time participants, most of
whom address GitHub issues labeled as “good first issue.” These labels have
proven effective in attracting new contributions. Our ongoing focus on
improving documentation aims to further lower the barrier to entry and
encourage continued engagement.

2025-08-20 — Richard Zowalla

## Description:
The mission of Apache StormCrawler is the creation and maintenance of software
related to an open source collection of resources for building low-latency,
scalable web crawlers on Apache Storm

## Project Status:
Current project status: active
Issues for the board: none

## Membership Data:
Apache StormCrawler was founded 2025-05-21 (3 months ago)
There are currently 10 committers and 5 PMC members in this project.
The Committer-to-PMC ratio is 2:1.

Community changes, past quarter:
- No new PMC members (project graduated recently).
- No new committers were added.

## Project Activity:
As we are now in the European summer holiday period, contributions have
temporarily slowed — which is expected and typical for this time of year.
Despite this, we continue to receive pull requests and interest from outside
contributors, which is a strong and encouraging sign of ongoing engagement
with the project. There has also been discussion around the existing project
logo, particularly the need to convert it into an SVG format to better support
branding needs. While no final decision has been made yet, this conversation
marks a positive step toward improving our visual identity as part of our
broader TLP transition.

We’ve also started work on overhauling our documentation to support better
onboarding and contributor engagement. Trademark-related tasks are in the
early planning stages.

## Community Health:
The StormCrawler community remains healthy and stable. Although activity has
slightly slowed due to the start of the summer holiday season in Europe,
contributions from new participants continue to arrive — including pull
requests and outreach from individuals outside the established group. Our
current focus on improved documentation should lower the barrier to entry for
new users and contributors. We hope that these efforts will further strengthen
engagement and participation over time.

2025-07-16 — Richard Zowalla

## Description:
The mission of Apache StormCrawler is the creation and maintenance of software
related to an open source collection of resources for building low-latency,
scalable web crawlers on Apache Storm

## Project Status:
Current project status: active
Issues for the board: none

## Membership Data:
Apache StormCrawler was founded 2025-05-21 (a month ago)
There are currently 10 committers and 5 PMC members in this project.
The Committer-to-PMC ratio is 2:1.

Community changes, past quarter:
- No new PMC members (project graduated recently).
- No new committers were added.

## Project Activity:
StormCrawler graduated from the Apache Incubator about two months ago. The
project has made our first official release as a TLP.

We have also implemented a new external module that leverages generative AI
for text extraction — offering a modern alternative to the existing rule-based
and XPath-based approaches. This enhancement brings StormCrawler's
capabilities closer to leading Python-based crawlers and reflects our
commitment to innovation and usability.

StormCrawler has maintained a stable user base over the past decade and
continues to be well-regarded. Although the number of committers and
contributors remains relatively small, the project's activity level is on par
with other established TLPs.

We’ve begun to receive contributions from outside the usual suspects, which is
encouraging. We hope some of these new contributors will stay and become
longer-term participants in the StormCrawler community.

We have started work on improved documentation to simplify onboarding for both
users and potential contributors. We also plan to begin working on
trademark-related tasks in the coming weeks, to ensure proper branding and
compliance as part of our transition to a full TLP.

Recent releases:
3.4.0 was released on 2025-06-27.


## Community Health:
The StormCrawler community remains active and stable. We’ve started to see
contributions from new participants outside the core group, which is a positive
sign for long-term growth. While the number of committers has not changed,
there is increased engagement from external contributors, and we hope some of
them will stay involved and eventually take on larger roles.

With work on improved documentation now underway, we aim to make it easier for
new users and contributors to get started and participate more actively. These
efforts are expected to further strengthen the project's community over time.

2025-06-18 — Richard Zowalla

## Description:
StormCrawler is a collection of resources for building low-latency,
customisable and scalable web crawlers on Apache Storm.

## Project Status:
Current project status: active
Issues for the board: none

## Membership Data:
Apache StormCrawler was founded 2025-05-21 (15 days ago)
There are currently 10 committers and 5 PMC members in this project.
The Committer-to-PMC ratio is 2:1.

Community changes, past quarter:
- No new PMC members (project graduated recently).
- No new committers were added.

## Project Activity:

StormCrawler graduated from the Apache Incubator about three weeks ago. The
project is now in the process of removing references to the Incubator and
establishing itself as a top-level project (TLP).

StormCrawler has maintained a stable user base over the past decade and
continues to be well-regarded. Although the number of committers and
contributors remains relatively small, the project's activity level is on par
with other established TLPs.

We recognize that StormCrawler can be challenging for new users to adopt. To
address this, we plan to develop comprehensive documentation aimed at
simplifying onboarding for both users and potential contributors.

Additionally, we are considering the development of a new external module that
leverages generative AI for text extraction  —offering an alternative to the
current rule-based and XPath-based approaches. This enhancement would align
our feature set more closely with leading Python-based crawlers, and we hope
it will attract a broader community of users and developers by offering
modern, state-of-the-art capabilities paired with our easy-to-use
documentation initiative.


## Community Health:
While the community remains active and stable, there is room for growth
through the engagement of new contributors.

2025-04-16 — in the Incubator's report

StormCrawler is a collection of resources for building low-latency,
customisable and scalable web crawlers on Apache Storm.

StormCrawler has been incubating since 2024-03-19.

### Three most important unfinished issues to address before graduating:

There are no remaining issues. After list discussions with our mentors, we
have
confirmed that it would be the right time for graduation.0

### Are there any issues that the IPMC or ASF Board need to be aware of?

None.

### How has the community developed since the last report?

StormCrawler remains well-established, with a steady user base over the
past decade.
While the number of committers and contributors remains small, the
project's activity level
is comparable to some established TLPs.

Seasoned committers with experience across various ASF projects continue
to contribute, ensuring the project's stability and sustainability.

Although community growth has been minimal (but did happen), there has been
some progress.

Additionally, the rise of generative AI has shifted focus toward
production-ready, turnkey solutions,
reducing the incentive for many users to contribute directly to
StormCrawler. Instead, they often
prefer to adopt mature, off-the-shelf software like StormCrawler rather
than actively participating in development.

This industry trend may explain the limited influx of new contributors
despite the project's ongoing relevance.

### How has the project developed since the last report?

The project has seen steady progress with various bug fixes and dependency
updates.
Additionally, there have been some external contributions to the
documentation,
indicating ongoing interest and engagement from the community.

### How would you assess the podling's maturity?

Please feel free to add your own commentary.

- [ ] Initial setup
- [ ] Working towards first release
- [ ] Community building
- [X] Nearing graduation
- [ ] Other:

The project is well-established, has maintained steady activity, and has
experienced contributors
who are familiar with ASF processes. While community growth has been
modest,
the project's engagement level and stability suggest it is ready for
graduation.

The presence of seasoned committers and ongoing development efforts further
support this assessment.

### Date of last release:

2025-03-24

### When were the last committers or PPMC members elected?

2024-09-21

### Have your mentors been helpful and responsive?

Yes, our mentors have been supportive, providing guidance throughout the
process.
They have been available for discussions, particularly regarding the
project's readiness for graduation,
and have helped ensure we are on the right track.

Their experience and insights have been valuable in navigating ASF
Incubator processes.

### Is the PPMC managing the podling's brand / trademarks?

Yes. The name was approved by VP Trademarks.

### Signed-off-by:

- [ ] (stormcrawler) Dave Fisher
   Comments:
- [ ] (stormcrawler) Lewis John McGibbney
   Comments:
- [X] (stormcrawler) Ayush Saxena
   Comments: Successfully managed multiple releases during incubation and
   now preparing for graduation.
- [X] (stormcrawler) PJ Fanning
   Comments: Discussing Graduation

### IPMC/Shepherd notes:

2025-02-19 — in the Incubator's report

StormCrawler is a collection of resources for building low-latency,
customisable and scalable web crawlers on Apache Storm.

StormCrawler has been incubating since 2024-03-19.

### Three most important unfinished issues to address before graduating:

1. Community building
2.
3.

### Are there any issues that the IPMC or ASF Board need to be aware of?

No.

### How has the community developed since the last report?

StormCrawler remains a rather mature and stable project, continuing to
serve its niche effectively. While there isn’t much new to report in terms
of major developments, we did have a contributor show up recently and
provide some pull requests, which is always a positive sign.

It’s worth noting that, even in the age of AI, the number of people
conducting their own large-scale web crawls remains relatively low. Many
opt to leverage datasets like Common Crawl rather than setting up and
maintaining their own crawling infrastructure. This makes community
contributions even more valuable, as StormCrawler continues to be a
reliable solution for those who do require custom crawling capabilities.

### How has the project developed since the last report?

A new release of StormCrawler was made.

However, one area of concern is the level of engagement among the initial
committers. Out of the five original committers, only three have been
actively contributing, while the remaining two have shown little to no
involvement since the project's incubation. While it's not uncommon to see
fluctuations in contributor activity due to shifting priorities and time
constraints, this does highlight the need to expand the committer base.
Therefore, we are happy that we could add an additional committer and PPMC
member since incubation.

### How would you assess the podling's maturity?

Please feel free to add your own commentary.

- [ ] Initial setup
- [ ] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:

### Date of last release:

2024-12-03

### When were the last committers or PPMC members elected?

2024-09-21

### Have your mentors been helpful and responsive?

Nothing of note.

### Is the PPMC managing the podling's brand / trademarks?

The name was approved by VP, Brand after consulting the Apache Storm
project.

### Signed-off-by:

- [X] (stormcrawler) Dave Fisher
   Comments:  The podling knows that community growth is required.
- [ ] (stormcrawler) Lewis John McGibbney
   Comments:
- [X] (stormcrawler) Ayush Saxena
   Comments:
- [X] (stormcrawler) PJ Fanning
   Comments:

### IPMC/Shepherd notes:

2024-10-16 — in the Incubator's report

StormCrawler is a collection of resources for building low-latency,
customisable and scalable web crawlers on Apache Storm.

StormCrawler has been incubating since 2024-03-19.

### Three most important unfinished issues to address before graduating:

1. Community building
2.
3.

### Are there any issues that the IPMC or ASF Board need to be aware of?
No

### How has the community developed since the last report?
Nothing new to report. One contributor showed up and provided some PRs,
which is a good sign.

### How has the project developed since the last report?
A first release was made.

A slight source of concern is that 3 out of the initial 5 committers have
so far shown no or very little involvement in the project since its
incubation, which makes it even more urgent to increase the committer
base.

### How would you assess the podling's maturity?
Please feel free to add your own commentary.

- [ ] Initial setup
- [ ] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:

### Date of last release:

2024-05-16

### When were the last committers or PPMC members elected?

No new committers yet.

### Have your mentors been helpful and responsive?
Nothing of note.

### Is the PPMC managing the podling's brand / trademarks?
No progress yet.

### Signed-off-by:

- [ ] (stormcrawler) Dave Fisher
   Comments:
- [ ] (stormcrawler) Lewis John McGibbney
   Comments:
- [X] (stormcrawler) Ayush Saxena
   Comments: Working towards building community
- [X] (stormcrawler) PJ Fanning
   Comments: Release made but may need more work on community building.

### IPMC/Shepherd notes:

2024-06-19 — in the Incubator's report

StormCrawler is a collection of resources for building low-latency,
customisable and scalable web crawlers on Apache Storm.

StormCrawler has been incubating since 2024-03-19.

### Three most important unfinished issues to address before graduating:

1. Community building
2.
3.

### Are there any issues that the IPMC or ASF Board need to be aware of?

Nothing yet.

### How has the community developed since the last report?

We got some involvement (issues, simple PRs) from outside the usual
suspects. We need to increase our outreach to attract more users /
developers to foster a healthy community development.

### How has the project developed since the last report?

We have published our first release (3.0). We are currently working on
adding the feedback received for 3.0.

### How would you assess the podling's maturity?

Please feel free to add your own commentary.

- [X] Initial setup
- [X] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:

### Date of last release:

2024-05-16

### When were the last committers or PPMC members elected?

No new committers yet.

### Have your mentors been helpful and responsive?

Nothing to note.

### Is the PPMC managing the podling's brand / trademarks?

No answer.

### Signed-off-by:

- [ ] (stormcrawler) Dave Fisher
   Comments:
- [ ] (stormcrawler) Lewis John McGibbney
   Comments:
- [ ] (stormcrawler) Ayush Saxena
   Comments:
- [ ] (stormcrawler) PJ Fanning
   Comments:

### IPMC/Shepherd notes:

2024-05-15 — in the Incubator's report

StormCrawler is a collection of resources for building low-latency,
customisable and scalable web crawlers on Apache Storm.

StormCrawler has been incubating since 2024-03-19.

### Three most important unfinished issues to address before graduating:

1. Community building
2. Work towards a first release
3.

### Are there any issues that the IPMC or ASF Board need to be aware of?

Nothing yet.

### How has the community developed since the last report?

We got some involvement (issues, simple doc PRs) from outside the usual
suspects.
We need to increase our outreach to attract more users / developers to
foster a healthy community development.

### How has the project developed since the last report?

Project is currently discussing to start a vote on a first release (3.0)
containing the breaking changes from joining as a poddling.
Website, build environment, etc. is set up.

### How would you assess the podling's maturity?
Please feel free to add your own commentary.

- [X] Initial setup
- [X] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:

### Date of last release:

No release yet.

### When were the last committers or PPMC members elected?

No new committers yet.

### Have your mentors been helpful and responsive?

Nothing to note.

### Is the PPMC managing the podling's brand / trademarks?

No answer.

### Signed-off-by:

- [X] (stormcrawler) Dave Fisher
   Comments: Good start to incubation
- [ ] (stormcrawler) Lewis John McGibbney
   Comments:
- [X] (stormcrawler) Ayush Saxena
   Comments:  The community is actively working towards their first ASF
   release
- [X] (stormcrawler) PJ Fanning
   Comments: Good progress setting up the podling and first release under
   discussion

### IPMC/Shepherd notes:

2024-04-17 — in the Incubator's report

StormCrawler is a collection of resources for building low-latency,
customisable and scalable web crawlers on Apache Storm.

StormCrawler has been incubating since 2024-03-19.

### Three most important unfinished issues to address before graduating:

1. Set up Git Repos and Builds
2. Community building
3. Work towards a new release

### Are there any issues that the IPMC or ASF Board need to be aware of?
Nothing yet.

### How has the community developed since the last report?
First Report.

### How has the project developed since the last report?
N/A

### How would you assess the podling's maturity?
Please feel free to add your own commentary.

- [X] Initial setup
- [X] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:

### Date of last release:

None.

### When were the last committers or PPMC members elected?
No new committers yet.

### Have your mentors been helpful and responsive?
Nothing to note.

### Is the PPMC managing the podling's brand / trademarks?
No answer.

### Signed-off-by:

- [ ] (stormcrawler) Dave Fisher
  Comments:
- [ ] (stormcrawler) Lewis John McGibbney
  Comments:
- [ ] (stormcrawler) Ayush Saxena
  Comments:
- [X] (stormcrawler) PJ Fanning
  Comments:

### IPMC/Shepherd notes:
The project is finished the setup. It's using wiki to hold the project
information.

Subscribe to ASF Plus One, Our Monthly Newsletter

Subscribe Now