What the board has decided about this committee or office, and the reports it filed, most recent first. Generated from the published minutes.
These categorised views are best effort. They are read from the published minutes by a program, and what it can attribute to a committee depends on how each resolution happens to be worded — so a page may be incomplete, and nothing here overrides the minutes themselves. The raw minutes are the source of truth.
Please note. The board approves the minutes of a meeting at the meeting after it, and they are published then - so the most recent meeting is not usually here. ASF Members can read the draft in the board's own repository until it is.
[raw] the published minutes, which are the record. [main index]
| Date | Action | Decided by |
|---|---|---|
| 2018-05-16 | Appointed Dionysios Logothetis | the board, by resolution |
| 2012-05-16 | Appointed Avery Ching | the board, by resolution |
| Date | Decision | Item | Outcome |
|---|---|---|---|
| 2023-09-20 | Terminate the Apache Giraph Project | special order | approved |
| 2012-05-16 | Establish the Apache Giraph Project | special order | approved |
No report was submitted.
No report was submitted. @Christofer: pursue an Attic resolution for Giraph
No report was submitted. @Christofer: pursue a roll call for Giraph
No report was submitted. @Christofer: pursue a report for Giraph
No report was submitted.
## Description: The mission of Giraph is the creation and maintenance of software related to Iterative graph processing system built for high scalability ## Issues: There are no issues requiring board attention. ## Membership Data: Apache Giraph was founded 2012-05-15 (11 years ago) There are currently 20 committers and 13 PMC members in this project. The Committer-to-PMC ratio is roughly 5:4. Community changes, past quarter: - No new PMC members. Last addition was Dionysios Logothetis on 2018-04-22. - No new committers. Last addition was Dionysios Logothetis on 2018-04-23. ## Project Activity: - No activity this last quarter - Last release: June 2020 ## Community Health: - Community remains inactive with no contributions this half from Meta (the main contributor) either.
## Description: The mission of Giraph is the creation and maintenance of software related to Iterative graph processing system built for high scalability ## Issues: There are no issues requiring board attention ## Membership Data: Apache Giraph was founded 2012-05-15 (11 years ago) There are currently 20 committers and 13 PMC members in this project. The Committer-to-PMC ratio is roughly 5:4. Community changes, past quarter: - No new PMC members. Last addition was Dionysios Logothetis on 2018-04-22. - No new committers. Last addition was Dionysios Logothetis on 2018-04-23. ## Project Activity: - No activity in the last quarter - Last release was in August 2020. ## Community Health: Meta has been the main contributor over the last few years, however activity has slowed down over time. The team that contributes to Giraph is considering its long term strategy around graph processing, and depending on this the project may pick up or actually slow down further. However, this will be determined in coming half.
No report was submitted.
## Description: The mission of Giraph is the creation and maintenance of software related to Iterative graph processing system built for high scalability ## Issues: There are no issues requiring board attention. ## Membership Data: Apache Giraph was founded 2012-05-16 (10 years ago) There are currently 20 committers and 13 PMC members in this project. The Committer-to-PMC ratio is roughly 5:4. Community changes, past quarter: - No new PMC members. Last addition was Dionysios Logothetis on 2018-04-23. - No new committers. Last addition was Dionysios Logothetis on 2018-04-23. ## Project Activity: - No activity in this quarter - Last release on June 11, 2020 ## Community Health: - There has been some interest from past collaborators to develop application on top of Apache Giraph, but there are currently no cycles to support them (e.g. answer questions in the users group, debug etc).
## Description: The mission of Giraph is the creation and maintenance of software related to Iterative graph processing system built for high scalability ## Issues: There are no issues requiring board attention ## Membership Data: Apache Giraph was founded 2012-05-15 (10 years ago) There are currently 20 committers and 13 PMC members in this project. The Committer-to-PMC ratio is roughly 5:4. Community changes, past quarter: - No new PMC members. Last addition was Dionysios Logothetis on 2018-04-22. - No new committers. Last addition was Dionysios Logothetis on 2018-04-23. ## Project Activity: - Minor changes to make one of the graph algorithms more generic. No other development otherwise. ## Community Health: - New activity/interest from people who want to develop algorithms on top of Giraph.
## Description: The mission of Giraph is the creation and maintenance of software related to Iterative graph processing system built for high scalability ## Issues: There are no issues requiring board attention. ## Membership Data: Apache Giraph was founded 2012-05-15 (10 years ago) There are currently 20 committers and 13 PMC members in this project. The Committer-to-PMC ratio is roughly 5:4. Community changes, past quarter: - No new PMC members. Last addition was Dionysios Logothetis on 2018-04-22. - No new committers. Last addition was Dionysios Logothetis on 2018-04-23. ## Project Activity: - Since the last report, there's only been a minor dependency upgrades ## Community Health: - Limited number of contributors that's mainly from Meta developers. At the same time, there's currently lack of resources to devote time in increasing community engagement.
## Description: The mission of Giraph is the creation and maintenance of software related to Iterative graph processing system built for high scalability ## Issues: There are no issues requiring board attention ## Membership Data: Apache Giraph was founded 2012-05-15 (9 years ago) There are currently 20 committers and 13 PMC members in this project. The Committer-to-PMC ratio is roughly 5:4. Community changes, past quarter: - No new PMC members. Last addition was Dionysios Logothetis on 2018-04-22. - No new committers. Last addition was Dionysios Logothetis on 2018-04-23. ## Project Activity: No activity this half. Last release: June 11, 2020 ## Community Health: We're in the process of recruiting people internally (Facebook) that may be contributing to the project in the coming half.
## Description: The mission of Giraph is the creation and maintenance of software related to Iterative graph processing system built for high scalability ## Issues: There are no issues requiring board attention. ## Membership Data: Apache Giraph was founded 2012-05-16 (9 years ago) There are currently 20 committers and 13 PMC members in this project. The Committer-to-PMC ratio is roughly 5:4. Community changes, past quarter: - No new PMC members. Last addition was Dionysios Logothetis on 2018-04-23. - No new committers. Last addition was Dionysios Logothetis on 2018-04-23. ## Project Activity: - New feature that adds support for authentication and authorization among Giraph workers, and encryption of data in transit. ## Community Health: - Not a lot of activity, but the new security feature implemented is important. - Last release on June 11, 2020
## Description: The mission of Giraph is the creation and maintenance of software related to Iterative graph processing system built for high scalability ## Issues: There are no issues requiring board attention. ## Membership Data: Apache Giraph was founded 2012-05-15 (9 years ago) There are currently 20 committers and 13 PMC members in this project. The Committer-to-PMC ratio is roughly 5:4. Community changes, past quarter: - No new PMC members. Last addition was Dionysios Logothetis on 2018-04-22. - No new committers. Last addition was Dionysios Logothetis on 2018-04-23. ## Project Activity: - No new commits - Security related feature currently under review ## Community Health: - Even though there was not much activity this quarter, we're adding a fairly important feature around authorization/authentication and data encryption.
## Description: The mission of Giraph is the creation and maintenance of software related to Iterative graph processing system built for high scalability ## Issues: There are no issues requiring board attention. ## Membership Data: Apache Giraph was founded 2012-05-15 (9 years ago) There are currently 20 committers and 13 PMC members in this project. The Committer-to-PMC ratio is roughly 5:4. Community changes, past quarter: - No new PMC members. Last addition was Dionysios Logothetis on 2018-04-22. - No new committers. Last addition was Dionysios Logothetis on 2018-04-23. ## Project Activity: - New implementation of edge storage mechanism that does not limit number of edges per vertex. This allows handling of graphs with high-degree vertices, a common production graph. ## Community Health: - Even though number of commits is low, this is the first time in a while that the project had a significant contribution from somebody besides the core Giraph team (see new feature mentioned above).
## Description: The mission of Giraph is the creation and maintenance of software related to Iterative graph processing system built for high scalability ## Issues: There are no issues requiring board attention ## Membership Data: Apache Giraph was founded 2012-05-15 (8 years ago) There are currently 20 committers and 13 PMC members in this project. The Committer-to-PMC ratio is roughly 5:4. Community changes, past quarter: - No new PMC members. Last addition was Dionysios Logothetis on 2018-04-22. - No new committers. Last addition was Dionysios Logothetis on 2018-04-23. ## Project Activity: - Added option for workers to automatically pick free server port - Fixed issue with network connection failure handling - Fixed bug in GC counter ## Community Health: - This quarter we got small activity from outside contributors. - Internal collaborators from Facebook will be contributing some optimizations they developed internally. - Started discussion with potential contributor from academia, with the goal to contribute algorithm implementations. This may not materialize immediately as there is some research involved.
## Description: The mission of Giraph is the creation and maintenance of software related to Iterative graph processing system built for high scalability ## Issues: There are no issues requiring board attention. ## Membership Data: Apache Giraph was founded 2012-05-15 (8 years ago) There are currently 20 committers and 13 PMC members in this project. The Committer-to-PMC ratio is roughly 5:4. Community changes, past quarter: - No new PMC members. Last addition was Dionysios Logothetis on 2018-04-22. - No new committers. Last addition was Dionysios Logothetis on 2018-04-23. ## Project Activity: - New release 1.3.0 - Minor updates on the website ## Community Health: No significant activity during this quarter. However, some personal correspondence outside the mailing lists indicates the project is used for academic purposes.
## Description: - Giraph is a Bulk Synchronous Parallel framework for writing programs that analyze large graphs on a Hadoop cluster. Giraph is similar to Google's Pregel system. ## Issues: - There are no issues requiring board attention at this time. ## Activity: - Cleaned up a set of unmaintained modules, related to supporting external storage. - Cleaned up unused dependencies - Upgraded findbugs dependency and fixed findbugs issues - Fixed jenkins build. ## Health report: - The project is currently mainly in maintenance mode. Apart from contributions from the Facebook team, it only has sporadic contributions from external people, and these are usually minor in importance. We have found it hard to engage new members, and this will likely not improve in the near future. ## PMC changes: - Currently 13 PMC members. - No new PMC members added in the last 3 months - Last PMC addition was Dionysios Logothetis on Sun Apr 22 2018 ## Committer base changes: - Currently 20 committers. - No new committers added in the last 3 months - Last committer addition was Dionysios Logothetis at Mon Apr 23 2018 ## Releases: - Last release was 1.2.0 on Thu Oct 20 2016 - We are in the process of making a new release. It is about to go in voting phase and should be in in the next report. ## Mailing list activity: - dev@giraph.apache.org had a 277% increase in traffic in the past quarter (132 emails compared to 35): ## Commit activity: - 14 commits in the past quarter (180% increase) - 2 code contributors in the past quarter (-33% decrease) ## JIRA activity: - See comments above about activity this quarter. - 15 issues opened in JIRA, past quarter (400% increase) - 91 issues closed in JIRA, past quarter (2933% increase)
## Description: The mission of Giraph is the creation and maintenance of software related to Iterative graph processing system built for high scalability ## Issues: There are no issues requiring board attention. ## Membership Data: Apache Giraph was founded 2012-05-15 (7 years ago) There are currently 20 committers and 13 PMC members in this project. The Committer-to-PMC ratio is roughly 5:4. Community changes, past quarter: - No new PMC members. Last addition was Dionysios Logothetis on 2018-04-22. - No new committers. Last addition was Dionysios Logothetis on 2018-04-23. ## Project Activity: - Improve handling of network connection failure, overall improving reliability. - Performance improvements in the counter collection mechanism. ## Community Health: - Decreased activity for this last quarter.
## Description: The mission of Giraph is the creation and maintenance of software related to Iterative graph processing system built for high scalability ## Issues: There are no issues requiring board attention. ## Membership Data: Apache Giraph was founded 2012-05-15 (7 years ago) There are currently 20 committers and 13 PMC members in this project. The Committer-to-PMC ratio is roughly 5:4. Community changes, past quarter: - No new PMC members. Last addition was Dionysios Logothetis on 2018-04-22. - No new committers. Last addition was Dionysios Logothetis on 2018-04-23. ## Project Activity: - Mechanism for maintaining counters depends on the underlying resource management (e.g. Hadoop, Yarn). Made a change that allows the use of counters independently from the resource management system. - Made the thrift client configurable. This ensures users with different requirements with respect to the thrift services can plug their own client (e.g. the may require security-related configuration). - Currently working on upgrading the Netty dependency. This is a core dependency that hasn't been updated for many years. It requires a lot of experimentation to ensure there are no regressions. This will be committed in the next couple of months. ## Community Health: - Even though it did not come from new contributors, due to the development of the features mentioned above, there was increased activity this last quarter.
## Description:
- Giraph is a Bulk Synchronous Parallel framework for writing programs that
analyze large graphs on a Hadoop cluster. Giraph is similar to Google's
Pregel system.
## Issues:
- There are no issues requiring board attention at this time.
## Activity:
- Only minor improvements in terms of commits.
## Health report:
- No significant activity in the last quarter.
- We expect to have at least a couple of contributions in the next half, one
is being currently developed, the other one is under discussion with one of
our contributors (decoupling the Giraph counter collection mechanism from
Hadoop).
## PMC changes:
- Currently 13 PMC members.
- No new PMC members added in the last 3 months
- Last PMC addition was Dionysios Logothetis on Sun Apr 22 2018
## Committer base changes:
- Currently 20 committers.
- No new committers added in the last 3 months
- Last committer addition was Dionysios Logothetis at Mon Apr 23 2018
## Releases:
- Last release was 1.2.0 on Thu Oct 20 2016
## Mailing list activity:
- We continue to have small but constant activity.
- dev@giraph.apache.org:
- 263 subscribers (down -1 in the last 3 months):
- 12 emails sent to list (30 in previous quarter)
- user@giraph.apache.org:
- 439 subscribers (down -2 in the last 3 months):
- 1 emails sent to list (5 in previous quarter)
## JIRA activity:
- 4 JIRA tickets created in the last 3 months
- 0 JIRA tickets closed/resolved in the last 3 months
## Description:
- Giraph is a Bulk Synchronous Parallel framework for writing programs that
analyze large graphs on a Hadoop cluster. Giraph is similar to Google's
Pregel system.
## Issues:
- There are no issues requiring board attention at this time.
## Activity:
- Only two minor fixes since last report
## Health report:
- While I've been working with a contributor that is developing a new
algorithm, due to increased workload, we haven't find the time to review
the code.
## PMC changes:
- Currently 13 PMC members.
- No new PMC members added in the last 3 months
- Last PMC addition was Dionysios Logothetis on Sun Apr 22 2018
## Committer base changes:
- Currently 20 committers.
- No new committers added in the last 3 months
- Last committer addition was Dionysios Logothetis at Mon Apr 23 2018
## Releases:
- Last release was 1.2.0 on Thu Oct 20 2016
## Mailing list activity:
- There's some small but constant activity on small issues
- dev@giraph.apache.org:
- 268 subscribers (down -1 in the last 3 months):
- 30 emails sent to list (69 in previous quarter)
- user@giraph.apache.org:
- 442 subscribers (up 1 in the last 3 months):
- 5 emails sent to list (5 in previous quarter)
## Description:
- Giraph is a Bulk Synchronous Parallel framework for writing programs that
analyze large graphs on a Hadoop cluster. Giraph is similar to Google's
Pregel system.
## Issues:
- There are no issues requiring board attention at this time.
## Activity:
- Moved repository to gitbox.
- Only a few commits this last quarter, but an important reliability fix was
made.
## Health report:
- Committee Health score: 0.62 (Mostly Okay)
- This last quarter there were only a few commits. We have a number of pull
requests that are still pending review due to increased workload for our
most experienced/active reviewers. I'm currently trying to pull into the
project a new member, but I expect it will take time until they ramp up and
are able to review code.
## PMC changes:
- Currently 13 PMC members.
- No new PMC members added in the last 3 months
- Last PMC addition was Dionysios Logothetis on Sun Apr 22 2018
## Committer base changes:
- Currently 20 committers.
- No new committers added in the last 3 months
- Last committer addition was Dionysios Logothetis at Mon Apr 23 2018
## Releases:
- Last release was 1.2.0 on Thu Oct 20 2016
## Mailing list activity:
- Activity in our mailing list was reduced relative to the last quarter, but
there were a couple of interactions involving a PMC member that had been
inactive for some time. I will be reaching out to see whether there is any
opportunity to involve them more.
- dev@giraph.apache.org:
- 269 subscribers (up 1 in the last 3 months):
- 61 emails sent to list (80 in previous quarter)
- user@giraph.apache.org:
- 441 subscribers (down -1 in the last 3 months):
- 5 emails sent to list (19 in previous quarter)
## JIRA activity:
- See comments above about activity this quarter.
- 6 JIRA tickets created in the last 3 months
- 0 JIRA tickets closed/resolved in the last 3 months
## Description:
- Giraph is a Bulk Synchronous Parallel framework for writing programs that
analyze large graphs on a Hadoop cluster. Giraph is similar to Google's
Pregel system.
## Issues:
- There are no issues requiring board attention at this time.
## Activity:
- Upgrade to Java 8 as the minimum requirement.
- Cleaning up old Hadoop profiles.
- Small fixes and improvements.
- More cleaning-up of old JIRA issues.
## Health report:
- Committee Health score: 1.43 (Mostly Okay)
- In this last quarter, we've seen small contributions from external users.
- I have also solicited a bit larger contributions from members of the
academic community: (i) one of them is the implementation of a new
technique for storing the graph in a compressed form. This currently under
review and has not been committed yet, (ii) a team of external
collaborators have submitted the implementation of a new algorithm for
review, (iii) I've asked another user to contribute a new algorithm
implementation. This is still under discussion as to what algorithm to
implement.
- New release was delayed as I'd like to do some more cleanup, mostly get rid
of old hadoop profiles, before this.
## PMC changes:
- Currently 13 PMC members.
- No new PMC members added in the last 3 months
- Last PMC addition was Dionysios Logothetis on Sun Apr 22 2018
## Committer base changes:
- Currently 20 committers.
- No new committers added in the last 3 months
- Last committer addition was Dionysios Logothetis at Mon Apr 23 2018
## Releases:
- Last release was 1.2.0 on Thu Oct 20 2016
## Mailing list activity:
- Even though there's been a decrease in mailing list members, we have
actually seen more activity in this last quarter.
- dev@giraph.apache.org:
- 268 subscribers (down -7 in the last 3 months):
- 93 emails sent to list (74 in previous quarter)
- user@giraph.apache.org:
- 442 subscribers (down -3 in the last 3 months):
- 19 emails sent to list (16 in previous quarter)
## JIRA activity:
- After a long time, this quarter there was a big pull request from a member
outside the Giraph committee (details in health report section).
- 12 JIRA tickets created in the last 3 months
- 14 JIRA tickets closed/resolved in the last 3 months
## Description:
- Giraph is a Bulk Synchronous Parallel framework for writing programs that
analyze large graphs on a Hadoop cluster. Giraph is similar to Google's
Pregel system.
## Issues:
- There are no issues requiring board attention at this time.
## Activity:
- Continued to clean-up old JIRA issues that had been resolved or were not
relevant any more.
- An improvement on the use of Kryo for serialization.
- Fixes in the Jenkins build, including the site build, and cleanup of unused
profiles.
- Small activity on documentation & logging from a new user.
## Health report:
- Committee Health score: 5.51 (Healthy)
- Following-up from the previous report, we had discussed with a team from
the industry, that was planning to start using and contributing to Apache
Giraph. However, this was delayed, and their current plan is to resume
engagement in the next quarter.
- We were planning to do a release with their help. If this delays further,
we will do a release in the next quarter.
## PMC changes:
- Currently 13 PMC members.
- No new PMC members added in the last 3 months
- Last PMC addition was Dionysios Logothetis on Sun Apr 22 2018
## Committer base changes:
- Currently 20 committers.
- No new committers added in the last 3 months
- Last committer addition was Dionysios Logothetis at Mon Apr 23 2018
## Releases:
- Last release was 1.2.0 on Thu Oct 20 2016
## Mailing list activity:
- dev@giraph.apache.org:
- 276 subscribers (up 0 in the last 3 months):
- 76 emails sent to list (142 in previous quarter)
- user@giraph.apache.org:
- 447 subscribers (down -2 in the last 3 months):
- 14 emails sent to list (4 in previous quarter)
## JIRA activity:
- 7 JIRA tickets created in the last 3 months
- 36 JIRA tickets closed/resolved in the last 3 months
## Description:
- Giraph is a Bulk Synchronous Parallel framework for writing programs
that analyze large graphs on a Hadoop cluster. Giraph is similar to
Google's Pregel system.
## Summary:
- Avery Ching has stepped down as VP of Giraph and the PMC voted to
nominate Dionysios Logothetis. The resolution has been added to the
board's agenda.
- We are actively trying to reinvigorate the community and the flow of
patches being committed has resumed.
- Since last report, we have added a few features around collecting
performance statistics and making it possible to act on it
(e.g. when excess Garbage Collection happens). These have proven
necessary tools in a large-scale production environment.
- In terms of increasing community engagement, we are in contact with
a team from the industry that is considering investing in Apache
Giraph and contributing to the project (details below).
## Issues:
- The PMC has requested a brand new member of the project, Dionysios
Logothetis, as the new VP. As a result, the Apache members on the
PMC (Avery Ching, Hyunsik Choi, Owen O'Malley, and Sebastian
Schelter) will need to be actively mentoring.
## Activity:
- Code contributions
- It is now possible to collect statistics on performance stragglers
and act on it through the Observer mechanism.
- New GC observers provide ability to define actions on GC events through
simple interface.
- Instantiation of custom OutEdges implementation is now more
configurable and more efficient.
- Improved serialization mechanism by reducing intermediate data copies.
- Bug fixes.
- We started cleaning-up JIRAs that have been completed, and closing
obsolete ones.
## Health report:
- We are in discussion with a team from the industry that want to
start building a graph analytics platform on top of Apache Giraph in
the next few years and plan to start contributing to the
project. They are already active by creating JIRAs and have
expressed interest in contributing specific tasks, such as cleaning
up obsolete hadoop profiles, and improving the Giraph testing
environment. They also want to become committers at some point.
- As a consequence, this will increase the diversity in the group of
committers, not just the numbers.
- We plan to clean-up the code in two ways (i) remove obsolete Hadoop
profiles. This will allow us to remove the need for the Munge
plugin, which will make it easier to develop and test code locally
(ii) remove unmaintained modules. These two items will remove some
unnecessary complexity from our build and make it easier to maintain
a healthy build. This is important for the overal health of the
project as it will make it easier for new contributors to start
working with Giraph.
- We plan to make a release after this clean-up.
## PMC changes:
- Currently 13 PMC members.
- Dionysios Logothetis was added to the PMC on Sun Apr 22 2018
## Committer base changes:
- Currently 20 committers.
- Dionysios Logothetis was added as a committer on Mon Apr 23 2018
## Releases:
- Last release was 1.2.0 on Thu Oct 20 2016
## JIRA activity:
- 24 JIRA tickets created in the last 3 months
- 16 JIRA tickets closed/resolved in the last 3 months
No report was submitted. @Mark: follow up to get a report
No report was submitted. @Brett: pursue a report for Giraph
No report was submitted. @Jim: pursue a report for Giraph
## Description:
- Giraph is a Bulk Synchronous Parallel framework for writing programs
that analyze large graphs on a Hadoop cluster. Giraph is similar to
Google's Pregel system.
## Issues:
- The VP hasn't been reliably submitting board reports.
+ Two reports in the last 12 months. Both reports were pretty minimal.
+ After reminder last month, no one stepped up to submit a report.
- The project is very inactive.
+ The only non-jira message to dev@giraph was from a board member.
+ There were 15 jiras created, but none committed.
+ Last release 10/21/2016.
## Activity:
- None.
## Health report:
- Very quiet
## PMC changes:
- Currently 12 PMC members.
- No new PMC members added in the last 3 months
- Last PMC addition was Sergey Edunov on Wed Aug 24 2016
## Committer base changes:
- Currently 19 committers.
- No new committers added in the last 3 months
- Last committer addition was Hassan Eslami at Fri Jul 15 2016
## Releases:
- Last release was 1.2.0 on Thu Oct 20 2016
## Mailing list activity:
- As stated above, only 1 non-jira message was sent to dev by a board
member. The 2 messages to user were about Gora's release and
Gora-Giraph.
- dev@giraph.apache.org:
- 278 subscribers (down -1 in the last 3 months):
- 67 emails sent to list (32 in previous quarter)
- user@giraph.apache.org:
- 455 subscribers (down -5 in the last 3 months):
- 2 emails sent to list (2 in previous quarter)
## JIRA activity:
- 15 JIRA tickets created in the last 3 months
- 0 JIRA tickets closed/resolved in the last 3 months
Giraph is a Bulk Synchronous Parallel (BSP) framework for writing programs that analyze large graphs on distributed machines. Giraph serves a similar use case as Google's Pregel system. It is one of the largest-scale open-source graph computing engines and runs on Facebook scale graphs with over 1 trillion edges in production. Project releases * No immediate plans for an upcoming new release - last major release 10/21/2016 Overall project activity since the last report * Making an effort to move away from the Hadoop framework and support generic schedulers * Several reliability improvements When were the last committers or PMC members elected? ** Targeting one new committer soon ** Hassan Eslami (Committer) on 7/15/2016 ** Sergey Edunov (PMC) on 8/15/2016 Mailing list members * Our mailing list is stable (not much change from the last report) ** user@ 457 -> 460 ** dev@ 281 -> 278
No report was submitted.
Giraph is a Bulk Synchronous Parallel framework for writing programs that analyze large graphs on a Hadoop cluster. Giraph is similar to Google's Pregel system. Project releases * No immediate plans for an upcoming new release - last major release 10/21/2016 Overall project activity since the last report * No major updates since the last report * Several critical bug fixes When were the last committers or PMC members elected? ** Hassan Eslami (Committer) on 7/15/2016 ** Sergey Edunov (PMC) on 8/15/2016 Mailing list members * Our mailing list is stable (not much change from the last report) ** user@ 457 -> 460 ** dev@ 281 -> 281
No report was submitted. @Phil: follow up to see if a new chair is needed and file a report next month
No report was submitted.
No report was submitted.
Giraph is a Bulk Synchronous Parallel framework for writing programs that analyze large graphs on a Hadoop cluster. Giraph is similar to Google's Pregel system. Project releases * No immediate plans for an upcoming new release - last major release 10/21/2016 Overall project activity since the last report * Major contribution for Scalable Hypergraph Partitioner algorithm * Many bug fixes When were the last committers or PMC members elected? ** Hassan Eslami (Committer) on 7/15/2016 ** Sergey Edunov (PMC) on 8/15/2016 Mailing list members * Our mailing list is stable (not much change from the last report) ** user@ 465 -> 457 ** dev@ 279 -> 281
No report was submitted.
No report was submitted. @Mark: pursue a report for Giraph
Giraph is a Bulk Synchronous Parallel framework for writing programs that analyze large graphs on a Hadoop cluster. Giraph is similar to Google's Pregel system. Project releases * Sergey and Roman completed the Giraph 1.2.0 release that includes the Blocks & Pieces framework, OOC processing, and Facebook configuration (https://blogs.apache.org/giraph/entry/giraph_1_2_0_release) * No immediate plans for an upcoming new release Overall project activity since the last report * Published a comparison between Giraph/GraphX https://code.facebook.com/posts/319004238457019/a-comparison-of-state-of-the-art-graph-processing-systems/ * Lots of repo clean up in preparation for the 1.2.0 release * Continued bug fixes When were the last committers or PMC members elected? ** Hassan Eslami (Committer) on 7/15/2016 ** Sergey Edunov (PMC) on 8/15/2016 Mailing list members * Our mailing list is stable (not much change from the last report) ** user@ 470 -> 465 ** dev@ 280 → 279
Giraph is a Bulk Synchronous Parallel framework for writing programs that analyze large graphs on a Hadoop cluster. Giraph is similar to Google's Pregel system. Project releases * Sergey and Roman are working on the new 1.2 release in the later part of 2016 that includes the Blocks & Pieces framework and OOC processing. This is the first release since Nov 2014 (1.1.0) so we are working out the issues and hope to made more frequent releases after we iron out the process. Overall project activity since the last report * Redesigned out-of-core mechanism, made it more performant and automated. It is running in production at Facebook. * Made it possible to store all partition data in a serialized form, to allow scaling to larger number of vertices (10s of billions) * Added FacebookConfiguration with all the recommended Giraph settings, to make it easier to get great performance * Moved partition exchange off of Zookeeper, making it possible to use arbitrarly large number of partitions * Continued bug fixes When were the last committers or PMC members elected? * We recently added a new committer and PMC member! ** Hassan Eslami on 7/15/2016 ** Sergey Edunov on 8/15/2016 Mailing list members * Our mailing list is stable (not much change from the last report) ** user@ 473 → 470 ** dev@ 280 → 280
Giraph is a Bulk Synchronous Parallel framework for writing programs that analyze large graphs on a Hadoop cluster. Giraph is similar to Google's Pregel system. Project releases * We still expect to make a new 1.2 release that includes the Blocks & Pieces framework and OOC processing next year. Overall project activity since the last report * Out-of-core is getting closer to being prodution ready * Lots of continued minor improvments * Bug fixes * 17 JIRAs resolved When were the last committers or PMC members elected? * Igor Kabiljo on 2/10/15 * The PMC is discussing potential new committers New community development * Sergey presented Apache Giraph and Darwini (generator of social graphs) at GraphHPC 2016 in Moscow: http://www.dislab.org/GraphHPC-2016/en/ * Apache Giraph has been used to compute Degrees of Separation at Facebook: https://research.facebook.com/blog/three-and-a-half-degrees-of-separation * VLDB'16 paper that designed a graph sparsification technique to speedup graph analysis and is developed on top of Apache Giraph www.vldb.org/pvldb/vol9/p672-kalavri.pdf * KDD'16 paper describing a new graph reordering algorithm that is helpful for graph and index compression. The distributed variant of the algorithm is implemented on top of Apache Giraph (http://arxiv.org/pdf/1602.08820.pdf) Mailing list members We continue to see modest mailing list growth. user@ 470 → 476 dev@ 280 → 283
Giraph is a Bulk Synchronous Parallel framework for writing programs that analyze large graphs on a Hadoop cluster. Giraph is similar to Google's Pregel system. Project releases * We expect to make a new 1.2 release that includes the Blocks & Pieces framework and OOC processing next year. Overall project activity since the last report * New out-of-core features being added * Use IP addresses for communication rather than hostnames * Fixing some bugs When were the last committers or PMC members elected? * Igor Kabiljo on 2/10/15 * We hope to propose a new committer shortly New community development * Avery Ching presented the industrial paper "One Trillion Edges: Graph Processing at Facebook-Scale" at VLDB 2015 in September Mailing list members We continue to see some mailing list growth. user@ 455 -> 470 dev@ 273 -> 280
No report was submitted.
No report was submitted.
No report was submitted.
Giraph is a Bulk Synchronous Parallel framework for writing programs that analyze large graphs on a Hadoop cluster. Giraph is similar to Google's Pregel system. Project releases * We expect to make a new 1.2 release that includes the Blocks & Pieces framework Overall project activity since the last report * Multithreaded graph mutation * Blocks & pieces framework * Lots of bug fixes When were the last committers or PMC members elected? * Igor Kabiljo on 2/10/15 New community development * Maja Kabiljo gave the talk "Large scale Collaborative Filtering using Apache Giraph" in the recent Hadoop Summit (https://www.youtube.com/watch?t=1668&v=LkvXc6zASvo) Mailing list members We continue to see mailing list growth. user@ 446 -> 455 dev@ 262 -> 273
No report was submitted.
No report was submitted.
No report was submitted.
Giraph is a Bulk Synchronous Parallel framework for writing programs that analyze large graphs on a Hadoop cluster. Giraph is similar to Google's Pregel system. Project releases * We do not anticipate any upcoming releases as 1.1.0 was recently completed. Overall project activity since the last report * Several bug fixes * In process ZooKeeper support added (Thanks Sergey!). When were the last committers or PMC members elected? * We have a new committer - Igor Kabiljob accepted on 2/10/15! New community development * We have an upcoming presentation at Facebook's F8 developer conference in March. Mailing list members We continue to see mailing list growth. user@ 437 -> 446 dev@ 260 -> 262
Giraph is a Bulk Synchronous Parallel framework for writing programs that analyze large graphs on a Hadoop cluster. Giraph is similar to Google's Pregel system. Project releases 1.1.0 - This was finally released by Roman on 11/26. Thanks Roman! Overall project activity since the last report Mostly bug fixes for the 1.1.0 release. When were the last committers or PMC members elected? We have a new committer - Sergey Edunov on 11/24! New community development Maja presented in Boston@Scale on 11/12 on how she used Giraph as the foundation for scalable collaborative filtering at Facebook (http://dataatscaleboston.splashthat.com/). Mailing list members We continue to see steady mailing list growth. user@ 429 -> 437 dev@ 250 -> 260
No report was submitted. @Rich: pursue a report for Giraph
Giraph is a Bulk Synchronous Parallel framework for writing programs that analyze large graphs on a Hadoop cluster. Giraph is similar to Google's Pregel system. Project releases 1.1.0 - We have continued delayed this release until Roman finds some time to work on it. Overall project activity since the last report The project continues to develop at a steady rate. We have added Phabricator support for increasing the number of review tools available. When were the last committers or PMC members elected? Our status is the same as the last report. Maja Kabiljo became a PMC member here on 4/22/2014. Pavan Kumar became a committer on 4/22/2014. I think we are getting closer to adding a new committer in the near future (i.e. by the next report). New community development Apache Giraph was presented by Claudio Martella in June at http://2014.budapestdwforum.com/. We will also be presenting in http://extremecomputingtraining.anl.gov/curriculum/agenda2014/. Mailing list members We continue to see steady mailing list growth. user@ 418 -> 429 dev@ 242 -> 250
Giraph is a Bulk Synchronous Parallel framework for writing programs that analyze large graphs on a Hadoop cluster. Giraph is similar to Google's Pregel system. Project releases 1.1.0 - We have delayed this release until Roman finds some time to work on it. Overall project activity since the last report Project activity has remained steady. Not much else to report here. When were the last committers or PMC members elected? We as happy to report that we added a PMC member (Maja Kabiljo - 4/22/2014) and a new committer (Pavan Kumar 4/22/2014) since the last report. New community development We recently held a Graph and Iterative Analytics meetup at Facebook in May. It was a well attended event with lots of interest in Giraph. Mailing list members user@ 379 -> 418 dev@ 231 -> 242
Giraph is a Bulk Synchronous Parallel framework for writing programs that analyze large graphs on a Hadoop cluster. Giraph is similar to Google's Pregel system. Project Status -------------- Upcoming releases: 1.1.0 - Getting close to done (coordinated by Roman Shaposhnik) Community --------- * In the past 30 days we have resolved 25 issues. * Presented at Strata 2014 - http://strataconf.com/strata2014/public/schedule/detail/32137 * Last committer voted in 11/2012 (Nitay Joeffe) * Last PMC member voted in 2/2014 (Eli Reisman) * Last release 5/2013 (1.0.0) Mailing lists: 231 subscribers on dev 379 subscribers on user
No report was submitted. AI: Greg to pursue a report for Giraph
Giraph is a Bulk Synchronous Parallel framework for writing programs that analyze large graphs on a Hadoop cluster. Giraph is similar to Google's Pregel system. Project Status -------------- Releases: 1.1.0 - Being discussed now (coordinated by Roman Shaposhnik) Community --------- * Roman Shaposhnik volunteered to coordinate the release of Giraph 1.1 * In the past 30 days we have resolved 11 issues. * Facebook published an article on Giraph usage scaling to 1 trillion edges - https://www.facebook.com/notes/facebook-engineering/scaling-apache-giraph-to-a-trillion-edges/10151617006153920 Mailing lists: 204 subscribers on dev 326 subscribers on user
Giraph is a Bulk Synchronous Parallel framework for writing programs that analyze large graphs on a Hadoop cluster. Giraph is similar to Google's Pregel system. Project Status -------------- Releases: 1.0.0 - released on 5/6/2013 1.1.0 - release expected in the fall Community --------- In the past 30 days we have resolved 15 issues. We presented our Giraph at the GraphLab workshop http://graphlab.org/graphlab-workshop-2013/preliminary-agenda/ and have been actively talking to folks about the problem. Mailing lists: 179 subscribers on dev 275 subscribers on user
Giraph is a Bulk Synchronous Parallel framework for writing programs that analyze large graphs on a Hadoop cluster. Giraph is similar to Google's Pregel system. Project Status: --------- Releases: 1.0.0 - Will be officially released today. Our first release after graduation! Community: --------- Eli Reisman was voted into the PMC. Lewis John Mcgibbney and Claudio Martella are GSoC mentors. Mailing lists: 168 subscribers on dev 237 subscribers on user
Giraph is a Bulk Synchronous Parallel framework for writing programs
that analyze large graphs on a Hadoop cluster. Giraph is similar to
Google's Pregel system.
Project Status:
---------
Releases:
0.2.0 - Delayed due to further API changes, will re-evaluate later this
month.
Community:
---------
These past months we have seen an increase in contributions from a
more diverse set of individuals. One contributor (Eli Reisman) is
working on getting Giraph to work natively on YARN, which will be
great for YARN and Giraph.
Mailing lists:
148 subscribers on dev
221 subscribers on user
Giraph is a Bulk Synchronous Parallel framework for writing programs
that analyze large graphs on a Hadoop cluster. Giraph is similar to
Google's Pregel system.
Project Status
--------------
Releases:
0.2.0 - expected sometime in December
* Currently, the codebase is improving too quickly to consider an
immediate release
Community
---------
Lately, the project has picked up steam and we are adding
improvements/fixing bugs at a fantastic rate. In the past 30 days we
have resolved 48 issues.
Mailing lists:
145 subscribers on dev
207 subscribers on user
Giraph is a Bulk Synchronous Parallel framework for writing programs
that analyze large graphs on a Hadoop cluster. Giraph is similar to
Google's Pregel system.
Project Status
--------------
Releases:
0.2.0 - expected early October
* Only use Netty for communication
Community
---------
We added two committers recently: Alessandro Presta and Eli Reisman.
In the past 30 days we have resolved 21 issues and have a lot of folks
trying out the system.
Mailing lists:
125 subscribers on dev
184 subscribers on user
No report was submitted.
Giraph is a Bulk Synchronous Parallel framework for writing programs that
analyze large graphs on a Hadoop cluster. Giraph is similar to Google's
Pregel system.
Project Status
--------------
Releases:
0.2.0 - expected 7/31
* Reduce memory consumption
* Improve support for the Green-Marl project.
The transition to being a full Apache project is nearly complete (still a
few references to incubator on the website).
Community
---------
Activity has picked up on Apache Giraph and more contributors seem to be
gaining interest and we had 24 commits for the month of June. We should
try to convert some contributors to committers soon.
Mailing lists:
116 subscribers on dev
155 subscribers on user
No report was submitted. AI: Rich to pursue a report for Giraph for next month
Giraph is a large-scale, fault-tolerant, Bulk Synchronous Parallel
(BSP)-based graph processing framework that runs on Hadoop. Giraph
entered the incubator in August 2011.
Project developments:
- First incubator release (version 0.1)
- Increased traffic on user list from new users
- Committer/PPMC member Claudio gave talk on Giraph at FOSDEM
(http://bit.ly/ClaudioGiraphTalk)
- "Processing over a billion edges on Apache Giraph", a talk by
Committer/PPMC member Avery accepted for Hadoop Summit in June.
- Community working with students at UC Irvine who are exploring
porting various algorithms to Giraph.
- 53 new JIRA issues opened since last report
- 36 JIRA issues closed since last report
Next steps:
- Another incubator release
- Adding new committers
Signed off by mentor: omalley, mattmann
Giraph is a large-scale, fault-tolerant, Bulk Synchronous Parallel (BSP)-based graph processing framework that runs on Hadoop. Giraph entered the incubator in August 2011. Project developments: * Sebastian Schelter, and Claudio Martella were added to the PPMC * Review Board in frequent use and high traffic on dev and commit lists * ICLA on file from all committers Next steps: * Adding new committers. * Making a release.
Giraph is a large-scale, fault-tolerant, Bulk Synchronous Parallel (BSP)-based graph processing framework that runs on Hadoop. Giraph entered the incubator in August 2011. Project developments: * JIRA activity steadily increased (57 issues reported so far) * added Jake Mannix and Dmitriy Ryaboy as committers/PPMC members Next steps: * Making a release. * Update on 1 initial committer who still hasn't filed an ICLA. He will fill off the ICLA by next week.
Giraph is a large-scale, fault-tolerant, Bulk Synchronous Parallel (BSP)-based graph processing framework that runs on Hadoop. Giraph entered the incubator in August 2011. Project developments: * Project website created. * Confluence wiki created. * Accounts were created for two of the committers. * Project is entirely on Apache infrastructure. Next steps: * Adding new committers. * Making a release. * One of the initial committers still hasn't filed an ICLA. We either need him to move forward or remove him.
Giraph is a large-scale, fault-tolerant, Bulk Synchronous Parallel (BSP)-based graph processing framework that runs on Hadoop. Giraph entered the incubator in August 2011. Project developments: * Project website created. * Confluence wiki created. * Accounts were created for two of the committers. * Project is entirely on Apache infrastructure. Next steps: * Adding new committers. * Making a release. * One of the initial committers still hasn't filed an ICLA. We either need him to move forward or remove him.
Giraph is a large-scale, fault-tolerant, Bulk Synchronous Parallel (BSP)-based graph processing framework that runs on Hadoop. Giraph entered the incubator in August 2011. Project developments: * Project status page created. * Subversion directories created and authorization granted. * Code grant received from Yahoo! * Mailing lists created. * Mentors all subscribed to private * Jira created. * Initial check on trademark status. * Confluence wiki requested.