Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Extra examples from Musketeer work #1

Open
wants to merge 19 commits into
base: release_0.5
Choose a base branch
from

Conversation

ms705
Copy link

@ms705 ms705 commented Jun 3, 2015

This pull request brings in some extra Naiad example jobs developed at Cambridge for the Musketeer paper (dl.acm.org/citation.cfm?id=2741968):

  • Netflix movie recommendation (dense matrix version, two implementations).
  • PageRank (two implementations, derived from GraphLINQ examples).
  • Single-source shortest path (SSSP).
  • k-means clustering.
  • JOIN and PROJECT micro-benchmarks.
  • TPC-H query 17 (Lindi and enhanced Lindi versions).
  • Top-shopper workflow.

The implementations are hand-written Naiad baselines, not auto-generated jobs from Musketeer. We used these jobs as our baselines in the paper.

We may need to do some code cleanup and add better documentation in order to merge these, but I thought it'd be best to open a PR and start the discussion, so that we can track changes here.

@michaelisard
Copy link

I am fine with adding these examples, but it might make sense to merge them with the fault tolerance branch which is really the active development branch now (e.g. it includes the improved graphlinq, as well as the fault tolerance work) instead of release_0.5. We should figure out what to do so that it builds with Mono without removing the Windows-only projects too.

@ms705
Copy link
Author

ms705 commented Jun 13, 2015

Good points. I'll remove the changes that break the Windows build and rebase the PR onto the development branch. The only argument in favour of merging this into release_0.5 is that the new examples would become available in the stable branch even before the 0.6 release is cut from the development branch. I'm happy to go either way :)

frameworks (which work on Windows only, as they require Peloponnese.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants