-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathrr-prize-winner-announcement.html
250 lines (171 loc) · 19.5 KB
/
rr-prize-winner-announcement.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd">
<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en" dir="ltr">
<!-- Mirrored from soundsoftware.ac.uk/rr-prize-winner-announcement by HTTrack Website Copier/3.x [XR&CO'2014], Tue, 01 Aug 2017 18:34:13 GMT -->
<!-- Added by HTTrack --><meta http-equiv="content-type" content="text/html;charset=utf-8" /><!-- /Added by HTTrack -->
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
<title>Reproducible Research prizes: we have winners! | Sound Software .ac.uk</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
<link rel="shortcut icon" href="sites/soundsoftware.ac.uk/files/favicon.png" type="image/x-icon" />
<link type="text/css" rel="stylesheet" media="all" href="sites/soundsoftware.ac.uk/files/css/css_96672be50d2b2bf1d283b8d9324e7be5.css" />
<link type="text/css" rel="stylesheet" media="print" href="sites/soundsoftware.ac.uk/files/css/css_9cb387b73479bd590fedb6ec230dc035.css" />
<!--[if IE]>
<link type="text/css" rel="stylesheet" media="all" href="/sites/all/themes/zen/zen/ie.css?j" />
<![endif]-->
<script type="text/javascript" src="sites/soundsoftware.ac.uk/files/js/js_5be44a4bd1f33d1988c9f73fe4b7f463.js"></script>
<script type="text/javascript">
<!--//--><![CDATA[//><!--
jQuery.extend(Drupal.settings, { "basePath": "/", "googleanalytics": { "trackOutbound": 1, "trackMailto": 1, "trackDownload": 1, "trackDownloadExtensions": "7z|aac|arc|arj|asf|asx|avi|bin|csv|doc(x|m)?|dot(x|m)?|exe|flv|gif|gz|gzip|hqx|jar|jpe?g|js|mp(2|3|4|e?g)|mov(ie)?|msi|msp|pdf|phps|png|ppt(x|m)?|pot(x|m)?|pps(x|m)?|ppam|sld(x|m)?|thmx|qtm?|ra(m|r)?|sea|sit|tar|tgz|torrent|txt|wav|wma|wmv|wpd|xls(x|m|b)?|xlt(x|m)|xlam|xml|z|zip" } });
//--><!]]>
</script>
<script type="text/javascript">
<!--//--><![CDATA[//><!--
(function(i,s,o,g,r,a,m){i["GoogleAnalyticsObject"]=r;i[r]=i[r]||function(){(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)})(window,document,"script","http://www.google-analytics.com/analytics.js","ga");ga("create", "UA-18698611-1", { "cookieDomain": "auto" });ga("set", "anonymizeIp", true);ga("send", "pageview");
//--><!]]>
</script>
<link rel="alternate" type="application/rss+xml" title="Subscribe" href="rss.xml" />
<meta name="google-site-verification" content="gKmyKIK_OFaFd5f07E7wIMUM59VMmUIZc7xa3qKgFEo" />
</head>
<body class="not-front not-logged-in node-type-story two-sidebars page-rr-prize-winner-announcement section-rr-prize-winner-announcement">
<div id="page"><div id="page-inner">
<a name="navigation-top" id="navigation-top"></a>
<div id="skip-to-nav"><a href="#navigation">Skip to Navigation</a></div>
<div id="header"><div id="header-inner" class="clear-block">
<div id="logo-title">
<a href="index.html" title="Home" rel="home">
<div id="site-name"><strong>
Sound Software .ac.uk </strong></div>
</a>
</div> <!-- /#logo-title -->
</div></div> <!-- /#header-inner, /#header -->
<div id="main"><div id="main-inner" class="clear-block with-navbar">
<div id="content"><div id="content-inner">
<div id="content-header">
<h1 class="title">Reproducible Research prizes: we have winners!</h1>
</div> <!-- /#content-header -->
<div id="content-area">
<div id="node-134" class="node node-type-story"><div class="node-inner">
<div class="content">
<p>We received an excellent set of entries to our first <a href="rr-prize.html">Reproducible Research Prize</a>, and we found it harder than expected to evaluate and to choose winners.</p>
<p>With the help of two panels of outside reviewers—thanks to the Software Sustainability Institute for reviewing the sustainability planning of entrants, and to willing external reviewers for judging potential to enable further research—we obtained a shortlist, and then narrowed down the entries to our eventual winners by applying an average of their scores across all criteria. See <a href="rr-prize-how.html">our page about the evaluation</a> for more details of how we scored the submissions.</p>
<p>The winners are:</p>
<h3>Conference paper (published)</h3>
<p><b>Winner</b><br />
Majdak, P., Iwaya, Y., Carpentier, T., Nicol, R., Parmentier, M., Roginska, A., Suzuki, Y., Watanabe, K., Wierstorf, H., Ziegelwanger, H., and Noisternig, M., <i>Spatially Oriented Format for Acoustics: A Data Exchange Format Representing Head-Related Transfer Functions</i> (<a href="http://sourceforge.net/projects/sofacoustics/files/SOFA specs 0.1 (as of AES 2013).pdf/download">paper</a>, <a href="http://sofacoustics.org/">site</a>, <a href="http://sf.net/projects/sofacoustics">code</a>)<br />
Submitted by Piotr Majdak.</p>
<p>This data exchange format, provided as a specification with software bindings and example data, was described by reviewers as having "potential to have a major positive impact on future research involving HRTFs, both in the UK and internationally" and praised by the sustainability panel for its engagement with standard formats and standards bodies.</p>
<p><b>Honourable mention</b><br />
Proutskova, P., Rhodes, C., Wiggins, G., and Crawford, T., <i>Breathy or Resonant – A Controlled and Curated Dataset for Phonation Mode Detection in Singing</i> (<a href="http://ismir2012.ismir.net/event/papers/589-ismir-2012.pdf">paper</a>, <a href="http://www.doc.gold.ac.uk/~mas02pp/phonation_modes">dataset</a>)<br />
Submitted by Polina Proutskova.</p>
<p>A newly recorded dataset of sung notes in different phonation modes. Reviewers were "pleased to see that the data collection was careful, employing a single singer with a recording environment that does not change" and appreciated the use of Creative Commons licensing.</p>
<p><b>Honourable mention</b><br />
Stowell, D., and Plumbley, M. D., <i>Multi-target pitch tracking of vibrato sources in noise using the GM-PHD filter</i> (<a href="http://c4dm.eecs.qmul.ac.uk/papers/2012/StowellPlumbley2012mml.pdf">paper</a>, <a href="https://github.com/danstowell/gmphd">code</a>)<br />
Submitted by Dan Stowell.</p>
<p>This work takes an algorithm known to the radar tracking community and adapts it to musical applications. Reviewers appreciated the open publication of source code and high level of replicability of the results in the paper.</p>
<h3>Journal submission</h3>
<p><b>Winner</b><br />
Sturm, B. L. and Gouyon, F., <i>Comments on “Automatic Classification of Musical Genres Using Inter-Genre Similarity”</i> (paper in review; <a href="http://imi.aau.dk/~bst/software/IGScode.zip">code</a>), submitted with Sturm, B. L., <i>On music genre classification via compressive sampling</i> (<a href="http://vbn.aau.dk/en/publications/on-music-genre-classification-via-compressive-sampling(55d669bd-b055-4ea9-8458-3b92ce164675).html">paper</a>, <a href="http://imi.aau.dk/~bst/software/CScode.zip">code</a>) and Sturm, B. L. and Noorzad, P., <i>On Automatic Music Genre Recognition by Sparse Representation Classification using Auditory Temporal Modulations</i> (<a href="http://vbn.aau.dk/en/publications/on-automatic-music-genre-recognition-by-sparse-representation-classification-using-auditory-temporal-modulations(a7c2e0cc-5c51-463f-b71f-26501f6f16aa).html">paper</a>, <a href="http://imi.aau.dk/~bst/software/CMMR2012MusicGenre.zip">code</a>)<br />
Submitted by Bob L. Sturm.</p>
<p>These three papers all address limitations of earlier work whose results appeared to be (and were) "too good to be true". Reviewers called this "a strong contribution towards reproducible research" and the panel found a respectable ease of replicability for the figures in the papers.</p>
<h3>Conference submission</h3>
<p><b>Winner</b><br />
Giannoulis, D., Stowell, D., Benetos, E., Rossignol, M., Lagrange, M., and Plumbley, M. D., <i>A Database and Challenge for Acoustic Scene Classification and Event Detection</i> (paper in review; <a href="http://c4dm.eecs.qmul.ac.uk/sceneseventschallenge/">site</a>, <a href="http://c4dm.eecs.qmul.ac.uk/sceneseventschallenge/description.html">data</a>, <a href="https://code.soundsoftware.ac.uk/projects/aasp-d-case-metrics">metric functions</a>, <a href="https://code.soundsoftware.ac.uk/projects/d-case-event">baseline system</a>, <a href="https://code.soundsoftware.ac.uk/projects/smacpy">baseline system</a>)<br />
Submitted by Dimitrios Giannoulis.</p>
<p>This project sets up a challenge in computational auditory scene analysis and presents baseline and metrics code in an open manner. Reviewers appreciated that "this project is a massive undertaking [that] will motivate a lot of work" and the panel noted that "the authors have taken great care in their sustainability planning".</p>
<h3>Special prize for a Technical Report</h3>
<p><b>Winner</b><br />
Raffel, C., and Ellis, D., <i>Reproducing Pitch Experiments in “Measuring the Evolution of Contemporary Western Popular Music”</i> (<a href="http://colinraffel.com/publications/report2013reproducing.pdf">paper</a>, <a href="https://github.com/craffel/music-evolution">code</a>)<br />
Submitted by Colin Raffel.</p>
<p>This report aims to reproduce the results of another research group from scratch and, in doing so, to understand and clarify some unstated assumptions in the initial paper. Reviewers thought "that this is valuable work which is likely to have produced a set of software tools that will be of much interest and usefulness to UK researchers in this field" and the panel found that the software "worked as described and reproduced the figures in the paper".</p>
</div>
<ul class="links inline"><li class="comment_forbidden first last"></li>
</ul>
</div></div> <!-- /node-inner, /node -->
</div>
</div></div> <!-- /#content-inner, /#content -->
<div id="navbar"><div id="navbar-inner" class="clear-block region region-navbar">
<a name="navigation" id="navigation"></a>
<div id="primary" class="clear-block">
<!-- <ul class="links"><li class="menu-245 first"><a href="/resources" title="">Resources</a></li>
<li class="menu-117"><a href="/activities" title="Activities">Activities</a></li>
<li class="menu-116 last"><a href="/aboutus" title="">About</a></li>
</ul> -->
<ul class="menu"><li class="expanded first"><a href="resources.html" title="">Resources</a><ul class="menu"><li class="leaf first"><a href="tools.html" title="Tools and Facilities">Tools</a></li>
<li class="leaf"><a href="handouts-guides.html" title="Printable Handouts and Guides">Handouts/Guides</a></li>
<li class="leaf"><a href="videos.html" title="Videos and slide presentations">Videos/Slides</a></li>
<li class="leaf"><a href="programming-examples.html" title="">Code examples</a></li>
<li class="leaf last"><a href="archive.html" title="">Blog archive</a></li>
</ul></li>
<li class="expanded"><a href="activities.html" title="Activities">Activities</a><ul class="menu"><li class="leaf first"><a href="rr-prize.html" title="Reproducible Research Prizes">Reproducible Research Prizes</a></li>
<li class="leaf"><a href="soundsoftware2014.html" title="SoundSoftware 2014: Third Workshop on Software and Data for Audio and Music Research">SoundSoftware 2014</a></li>
<li class="leaf"><a href="soundsoftware2013.html" title="SoundSoftware 2013: Workshop on Software and Data for Audio and Music Research">SoundSoftware 2013</a></li>
<li class="leaf last"><a href="soundsoftware2012.html" title="SoundSoftware 2012: Workshop on Software and Data for Audio and Music Research">SoundSoftware 2012</a></li>
</ul></li>
<li class="expanded last"><a href="aboutus.html" title="">About</a><ul class="menu"><li class="leaf first"><a href="overview.html" title="Our aim">Our aim</a></li>
<li class="leaf"><a href="aboutus.html" title="">Who we are</a></li>
<li class="leaf last"><a href="contact.html" title="Contact us">Contact us</a></li>
</ul></li>
</ul> </div> <!-- /#primary -->
</div></div> <!-- /#navbar-inner, /#navbar -->
<div id="sidebar-left"><div id="sidebar-left-inner" class="region region-left">
<div id="block-block-9" class="block block-block region-odd odd region-count-1 count-1"><div class="block-inner">
<div class="content">
<p><a class="twitter-timeline" href="https://twitter.com/soundsoftwareuk" data-widget-id="368361225786126337" height="500" width="auto" data-chrome="nofooter noborders transparent" data-border-color="#3e442c" data-link-color="#be5600">Tweets by @soundsoftwareuk</a></p>
<script>!function(d,s,id){var js,fjs=d.getElementsByTagName(s)[0],p=/^http:/.test(d.location)?'http':'https';if(!d.getElementById(id)){js=d.createElement(s);js.id=id;js.src=p+"://platform.twitter.com/widgets.js";fjs.parentNode.insertBefore(js,fjs);}}(document,"script","twitter-wjs");</script> </div>
</div></div> <!-- /block-inner, /block -->
<div id="block-views-recent_stories-block_1" class="block block-views region-even even region-count-2 count-2"><div class="block-inner">
<h2 class="title">Recent notes</h2>
<div class="content">
<div class="view view-recent-stories view-id-recent_stories view-display-id-block_1 recentnotes view-dom-id-6dd2c68a7e7bfbc67dc42c032d055245">
<div class="view-content">
<div class="views-row views-row-1 views-row-odd views-row-first">
<div class="views-field views-field-title"> <span class="field-content"><a href="rr-prize-mlsp-2014-winners.html">MLSP Prizes for Reproducibility: Winners announced!</a></span> </div>
<div class="views-field views-field-teaser"> <div class="field-content"><p>Announcing the winners of the MLSP 2014 and SoundSoftware.ac.uk Prizes for Reproducibility in Signal Processing, organised by SoundSoftware.ac.uk in conjuction with the IEEE Signal Processing Society for the 2014 IEEE International Workshop on Machine Learning for Signal Processing.</p>
</div> </div> </div>
<div class="views-row views-row-2 views-row-even">
<div class="views-field views-field-title"> <span class="field-content"><a href="soundsoftware2014-videos-available.html">SoundSoftware 2014: Videos now available!</a></span> </div>
<div class="views-field views-field-teaser"> <div class="field-content"><p>The SoundSoftware 2014 workshop, our third annual workshop on software and data in audio and music research, was just as enjoyable as the previous two. Because so much research in this field ends up being expressed through software, a software workshop turns out to be all about the means by which research becomes useful and relevant to people other than the original researchers—fertile ground for interesting and thought-provoking talks.</p>
<p>The workshop videos are now available online at <a href="soundsoftware2014.html" title="http://soundsoftware.ac.uk/soundsoftware2014">http://soundsoftware.ac.uk/soundsoftware2014</a>, so if you weren't able to make it in person, catch up here!</p>
</div> </div> </div>
<div class="views-row views-row-3 views-row-odd views-row-last">
<div class="views-field views-field-title"> <span class="field-content"><a href="soundsoftware2014-registernow.html">Register now for the SoundSoftware Third Workshop!</a></span> </div>
<div class="views-field views-field-teaser"> <div class="field-content"><p>Our third annual one-day workshop on Software and Data for Audio and Music Research takes place on the 8th of July 2014 at Queen Mary, University of London. The workshop includes talks on issues such as robust software development for audio and music research, reproducible research in general, management of research data, and open access. <a href="soundsoftware2014.html">Read more here</a>, clear your calendar, and register now!</p>
</div> </div> </div>
</div>
</div> </div>
</div></div> <!-- /block-inner, /block -->
</div></div> <!-- /#sidebar-left-inner, /#sidebar-left -->
<div id="sidebar-right"><div id="sidebar-right-inner" class="region region-right">
<div id="block-search-0" class="block block-search region-odd odd region-count-1 count-3"><div class="block-inner">
<div class="content">
<form action="http://soundsoftware.ac.uk/rr-prize-winner-announcement" accept-charset="UTF-8" method="post" id="search-block-form">
<div><div class="container-inline">
<div class="form-item" id="edit-search-block-form-1-wrapper">
<label for="edit-search-block-form-1">Search this site: </label>
<input type="text" maxlength="128" name="search_block_form" id="edit-search-block-form-1" size="15" value="" title="Enter the terms you wish to search for." class="form-text" />
</div>
<input type="submit" name="op" id="edit-submit" value="Search" class="form-submit" />
<input type="hidden" name="form_build_id" id="form-Tdjx_TZo5AxYnjdTeNo7rbw_m2s741nBNwOioumxP9s" value="form-Tdjx_TZo5AxYnjdTeNo7rbw_m2s741nBNwOioumxP9s" />
<input type="hidden" name="form_id" id="edit-search-block-form" value="search_block_form" />
</div>
</div></form>
</div>
</div></div> <!-- /block-inner, /block -->
<div id="block-block-8" class="block block-block region-even even region-count-2 count-4"><div class="block-inner">
<div class="content">
<p><a href="archive.html">Archive</a></p>
</div>
</div></div> <!-- /block-inner, /block -->
</div></div> <!-- /#sidebar-right-inner, /#sidebar-right -->
</div></div> <!-- /#main-inner, /#main -->
<div id="footer"><div id="footer-inner" class="region region-footer">
<div id="block-block-1" class="block block-block region-odd odd region-count-1 count-5"><div class="block-inner">
<div class="content">
<p><span class="f-left"><a rel="license" href="http://creativecommons.org/licenses/by-nc/3.0/" target="_blank"><img alt="Creative Commons Licence" style="margin-top: 2px; margin-right: 4px; border-width:0; float:left; " src="http://i.creativecommons.org/l/by-nc/3.0/88x31.png" /></a><span>This work is licensed under a <a rel="license" href="http://creativecommons.org/licenses/by-nc/3.0/">Creative Commons Attribution-NonCommercial 3.0 License</a>.<br /> © 2011 Queen Mary University of London </span></span><span class="f-right"><a rel="rss" href="rss.xml" target="_blank"><img alt="Subscribe to this site's RSS feed" style="margin-top: -2px; margin-right: 4px; border-width:0; float:left; " src="sites/all/themes/soundsoftware/socialnet_icons/rss_16.png" /></a><a rel="twitter" href="http://twitter.com/soundsoftwareuk" target="_blank"><img alt="Follow us on Twitter!" style="margin-top: -2px; margin-right: 4px; border-width:0; float:left; " src="sites/all/themes/soundsoftware/socialnet_icons/twitter_16.png" /></a><a rel="linkedin group" href="http://www.linkedin.com/groups?mostPopular=&gid=3472350" target="_blank"><img alt="Join or follow our LinkedIn group" style="margin-top: -2px; margin-right: 4px; border-width:0; float:left; " src="sites/all/themes/soundsoftware/socialnet_icons/linkedin_16.png" /></a></span></p>
</div>
</div></div> <!-- /block-inner, /block -->
</div></div> <!-- /#footer-inner, /#footer -->
</div></div> <!-- /#page-inner, /#page -->
</body>
<!-- Mirrored from soundsoftware.ac.uk/rr-prize-winner-announcement by HTTrack Website Copier/3.x [XR&CO'2014], Tue, 01 Aug 2017 18:34:13 GMT -->
</html>