Skip to content

MCH: MetaCPAN Hackathon

Thomas Sibley edited this page Nov 17, 2016 · 40 revisions

Nov 17 - 20 @ ServerCentral in Chicago

Goals / plans for the MetaCPAN Hackathon

Switch to new ES index

  • Review ES configuration and indexing is optimal and does not need a re-index (PRE MC::Hack)
  • Look at snapshots/backups
  • Migrate user data

Fix:

  • Login / rating problem to be fixed
  • Counting of feature requests/roadmap as "issues" (perhaps via whitelist tags etc)

Discuss, make plans, work on:

  • Improve search results to match expectations!

  • Improve Perl releases

  • Unified logging system in place (Logstash/Kibana - ES 5 on a BM box)?

  • ES backup / restore / reindex processes we should have documented

  • Postgres data source (and infrastructure)

  • Cleaning up code...

    • Move some search queries from web to api.. So avoiding duplication in clients... should have a separate namespace? - warnings about usage?...
    • Documentation
    • Tests
    • Gutting or reworking async in metacpan-web
  • Can we re-index to a new index without taking down the primary (for re-building from scratch)?

  • How does/could full reindex/rebuilding of data preserve the point-in-time "was this release authorized?" values?

    • Currently seems to only check the current 02packages + 06perms.
    • May be performance hit since it needs looking up for all ~300k releases, but it seems important to get right if MetaCPAN's API is to be used by CPAN clients.

Confirmed Attendees

  • Olaf Alders
  • Leo Lapworth (Ranguard)
  • Mickey Nasriachi
  • Joel Berger
  • Thomas Sibley (trs)
  • Brad Lhotsky (reyjrar)

Flight details:

  • Leo
    • LHR->ORD BA1544, 11:50 Wed 16 Nov 2016 (arriving Wed, get to apartment 4ish local time)
    • ORD->LHR BA1543, 19:00 Sun 20 Nov 2016
  • Olaf
    • YTZ ✈ MDW PD397, 21:25 Wed 16 Nov 2016 (arriving Wed apartment 11pm ish)
    • MDW ✈ YTZ PD394, 19:35 Sun 20 Nov 2016
  • Mickey
    • AMS->ORD LH9154, 13:20 Tue 15 Nov 2016 (arriving on Tuesday)
    • ORD->MUC LH435, 21:35 Sun 20 Nov 2016
    • MUC->AMS LH2306, 14:40 Mon 21 Nov 2016
  • Thomas
    • SEA ✈ ORD UA670, arriving 19:35 Wed 16 Nov 2016
    • ORD ✈ SEA ASA21, departing 19:50 Sun 20 Nov 2016
  • Graham
    • BWI->ORD NK369, 18:57 Thu 10 Nov 2016 (arrived already!)
    • ORD->BWI NK992, 20:27 Sun 20 Nov 2016
  • Brad
    • OAK ✈ MDW SW2167, 21:05 Wed 16 Nov 2016 (arriving Wed apartment 10pm ish)
    • MDW ✈ OAK SW2427, 08:10 Sun 20 Nov 2016