Diff: rfc9307v2.txt - rfc9307.txt

	rfc9307v2.txt	rfc9307.txt

	Internet Architecture Board (IAB) N. ten Oever	Internet Architecture Board (IAB) N. ten Oever
	Request for Comments: 9307 University of Amsterdam	Request for Comments: 9307 University of Amsterdam
	Category: Informational C. Cath	Category: Informational C. Cath

	ISSN: 2070-1721	ISSN: 2070-1721 University of Cambridge
	M. Kühlewind	M. Kühlewind
	Ericsson	Ericsson
	C. S. Perkins	C. S. Perkins
	University of Glasgow	University of Glasgow
	August 2022	August 2022

	Report from the IAB Workshop on Analyzing IETF Data (AID) 2021	Report from the IAB Workshop on Analyzing IETF Data (AID) 2021

	Abstract	Abstract


	skipping to change at line 85 ¶	skipping to change at line 85 ¶
	Appendix A. Data Taxonomy	Appendix A. Data Taxonomy
	Appendix B. Program Committee	Appendix B. Program Committee
	Appendix C. Workshop Participants	Appendix C. Workshop Participants
	IAB Members at the Time of Approval	IAB Members at the Time of Approval
	Acknowledgments	Acknowledgments
	Authors' Addresses	Authors' Addresses

	1. Introduction	1. Introduction

	The IETF, as an international Standards Developing Organization	The IETF, as an international Standards Developing Organization

	(SDO), hosts a diverse set of data about about the IETF's history and	(SDO), hosts a diverse set of data about the IETF's history and
	development, current standardisation activities, Internet protocols,	development, current standardisation activities, Internet protocols,
	and the institutions that comprise the IETF. A large portion of this	and the institutions that comprise the IETF. A large portion of this
	data is publicly available, yet it is underutilized as a tool to	data is publicly available, yet it is underutilized as a tool to
	inform the work in the IETF or the broader research community that is	inform the work in the IETF or the broader research community that is
	focused on topics like Internet governance and trends in information	focused on topics like Internet governance and trends in information
	and communication technologies (ICT) standard setting.	and communication technologies (ICT) standard setting.

	The aim of the "IAB Workshop on Analyzing IETF Data (AID) 2021"	The aim of the "IAB Workshop on Analyzing IETF Data (AID) 2021"
	workshop was to study how IETF data is currently used, to understand	workshop was to study how IETF data is currently used, to understand
	what insights can be drawn from that data, and to explore open	what insights can be drawn from that data, and to explore open

	skipping to change at line 114 ¶	skipping to change at line 114 ¶

	The workshop was organized with two all-group discussion slots at the	The workshop was organized with two all-group discussion slots at the
	beginning and the end of the workshop. In between, the workshop	beginning and the end of the workshop. In between, the workshop
	participants organized hackathon activities based on topics	participants organized hackathon activities based on topics
	identified during the initial discussion and in submitted position	identified during the initial discussion and in submitted position
	papers. The following topic areas were identified and discussed.	papers. The following topic areas were identified and discussed.

	2.1. Tools, Data, and Methods	2.1. Tools, Data, and Methods

	The IETF holds a wide range of data sources. The main ones used are	The IETF holds a wide range of data sources. The main ones used are

	the mailinglist archives (https://mailarchive.ietf.org/arch/)	the mailinglist archives [Mail-Arch], RFCs [IETF-RFCs], and the
	[Mail-Arch], RFCs (https://www.ietf.org/standards/rfcs/) [IETF-RFCs],	datatracker [Datatracker]. The latter provides information on
	and the datatracker (https://datatracker.ietf.org/) [Datatracker].	participants, authors, meeting proceedings, minutes, and more
	The latter provides information on participants, authors, meeting	[Data-Overview]. Furthermore, there are statistics for the IETF
	proceedings, minutes, and more (https://notes.ietf.org/iab-aid-	websites [IETF-Statistics], the working group Github repositories,
	datatracker-database-overview#) [Data-Overview]. Furthermore, there	and the IETF survey data [Survey-Data]. There was discussion about
	are statistics for the IETF websites (https://www.ietf.org/policies/	the utility of download statistics for the RFCs themselves from
	web-analytics/) [IETF-Statistics], the working group Github
	repositories, and the IETF survey data (https://www.ietf.org/blog/
	ietf-community-survey-2021/) [Survey-Data]. There was discussion
	about the utility of download statistics for the RFCs themselves from
	different repos.	different repos.

	There is a wide range of tools to analyze this data produced by IETF	There is a wide range of tools to analyze this data produced by IETF
	participants or researchers interested in the work of the IETF. Two	participants or researchers interested in the work of the IETF. Two
	projects that presented their work at the workshop were BigBang	projects that presented their work at the workshop were BigBang

	(https://bigbang-py.readthedocs.io/en/latest/) [BigBang] and	[BigBang] and Sodestream's IETFdata [ietfdata] library. The RFC
	Sodestream's IETFdata (https://github.com/glasgow-ipl/ietfdata)	Prolog Database was described in a submitted paper (see Section 4
	[ietfdata] library. The RFC Prolog Database was described in a	below). These projects could provide additional insight into
	submitted paper (see Section 4 below). These projects could provide	existing IETF statistics [ArkkoStats] and datatracker statistics
	additional insight into existing IETF statistics
	(https://www.arkko.com/tools/docstats.html) [ArkkoStats] and
	datatracker statistics (https://datatracker.ietf.org/stats/)
	[DatatrackerStats], e.g., gender-related information. Privacy issues	[DatatrackerStats], e.g., gender-related information. Privacy issues
	and the implications of making such data publicly available were	and the implications of making such data publicly available were
	discussed as well.	discussed as well.

	The datatracker itself is a community tool that welcomes	The datatracker itself is a community tool that welcomes
	contributions; for example, for additions to the existing interfaces	contributions; for example, for additions to the existing interfaces
	or the statistics page directly, see the Datatracker Database	or the statistics page directly, see the Datatracker Database

	Overview <https://notes.ietf.org/iab-aid-datatracker-database-	Overview [Data-Overview]. At the time of the workshop, instructions
	overview#> [Data-Overview]. At the time of the workshop,	about how to set up a local development environment could be found at
	instructions about how to set up a local development environment	IAB AID Workshop Data Resources [DataResources]. Questions or
	could be found at IAB AID Workshop Data Resources	discussion about the datatracker and possible enhancements can be
	<https://notes.ietf.org/iab-aid-data-resources> [DataResources].	sent to tools-discuss@ietf.org.
	Questions or discussion about the datatracker and possible
	enhancements can be sent to tools-discuss@ietf.org.

	2.2. Observations on Affiliation and Industry Control	2.2. Observations on Affiliation and Industry Control

	A large portion of the submitted position papers indicated interest	A large portion of the submitted position papers indicated interest
	in researching questions about industry control in the	in researching questions about industry control in the
	standardization process (as opposed to individual contributions in a	standardization process (as opposed to individual contributions in a
	personal capacity), where industry control covers both a) technical	personal capacity), where industry control covers both a) technical
	contributions and the ability to successfully standardize these	contributions and the ability to successfully standardize these
	contributions and b) competition on leadership roles. To assess	contributions and b) competition on leadership roles. To assess
	these questions, investigating participant affiliations, including	these questions, investigating participant affiliations, including

	skipping to change at line 185 ¶	skipping to change at line 176 ¶

	Furthermore, there is the issue of mergers, acquisitions, and	Furthermore, there is the issue of mergers, acquisitions, and
	subsidiary companies. There is no authoritative exogenous source of	subsidiary companies. There is no authoritative exogenous source of
	variation for affiliation changes, so hand-collected and curated data	variation for affiliation changes, so hand-collected and curated data
	is used to analyze changes in affiliation over time. While this	is used to analyze changes in affiliation over time. While this
	approach is imperfect, conclusions can be drawn from the data. For	approach is imperfect, conclusions can be drawn from the data. For
	example, in the case of mergers or acquisition where a small	example, in the case of mergers or acquisition where a small
	organization joins a large organization, this results in a	organization joins a large organization, this results in a
	statistically significant increase in likelihood of an individual	statistically significant increase in likelihood of an individual
	being put in a working group chair position (see the document by	being put in a working group chair position (see the document by

	Baron and Kanevskaia (https://www.iab.org/wp-content/IAB-	Baron and Kanevskaia [LEADERSHIP-POSITIONS]).
	uploads/2021/11/Baron.pdf) [LEADERSHIP-POSITIONS]).

	2.3. Community and Diversity	2.3. Community and Diversity

	The workshop participants were highly interested in using existing	The workshop participants were highly interested in using existing
	data to better understand who the current IETF community is. They	data to better understand who the current IETF community is. They
	were also interested in the community's diversity and how to	were also interested in the community's diversity and how to
	potentially increase it and thereby increase inclusivity, e.g.,	potentially increase it and thereby increase inclusivity, e.g.,
	understanding if there are certain factors that "drive people away"	understanding if there are certain factors that "drive people away"
	and why. Inclusivity and transparency about the standardization	and why. Inclusivity and transparency about the standardization
	process are generally important to keep the Internet and its	process are generally important to keep the Internet and its

	skipping to change at line 355 ¶	skipping to change at line 345 ¶
	Future workshops that choose to integrate a hackathon could consider	Future workshops that choose to integrate a hackathon could consider
	asking participants to submit issues and questions beforehand	asking participants to submit issues and questions beforehand
	(potentially as part of the position papers or the sign-up process)	(potentially as part of the position papers or the sign-up process)
	to facilitate the formation of groups.	to facilitate the formation of groups.

	4. Position Papers	4. Position Papers

	4.1. Tools, Data, and Methods	4.1. Tools, Data, and Methods

	Sebastian Benthall, "Using Complex Systems Analysis to Identify	Sebastian Benthall, "Using Complex Systems Analysis to Identify

	Organizational Interventions" <https://www.iab.org/wp-content/IAB-	Organizational Interventions" [COMPLEX-SYSTEMS]
	uploads/2021/11/Benthall.pdf> [COMPLEX-SYSTEMS]


	Stephen McQuistin, Colin Perkins, "The ietfdata Library"	Stephen McQuistin and Colin Perkins, "The ietfdata Library"
	<https://www.iab.org/wp-content/IAB-uploads/2021/11/McQuistin.pdf>
	[ietfdata-Library]	[ietfdata-Library]


	Marc Petit-Huguenin, "The RFC Prolog Database" <https://www.iab.org/	Marc Petit-Huguenin, "The RFC Prolog Database" [PROLOG-DATABASE]
	wp-content/IAB-uploads/2021/11/Petit-Huguenin.txt> [PROLOG-DATABASE]

	Jari Arkko, "Observations about IETF process measurements"	Jari Arkko, "Observations about IETF process measurements"

	<https://www.iab.org/wp-content/IAB-uploads/2021/11/Arkko.pdf>
	[MEASURING-IETF-PROCESSES]	[MEASURING-IETF-PROCESSES]

	4.2. Observations on Affiliation and Industry Control	4.2. Observations on Affiliation and Industry Control


	Justus Baron, Olia Kanevskaia, "Competition for Leadership Positions	Justus Baron and Olia Kanevskaia, "Competition for Leadership
	in Standards Development Organizations" <https://www.iab.org/wp-	Positions in Standards Development Organizations"
	content/IAB-uploads/2021/11/Baron.pdf> [LEADERSHIP-POSITIONS]	[LEADERSHIP-POSITIONS]

	Nick Doty, "Analyzing IETF Data: Changing affiliations"	Nick Doty, "Analyzing IETF Data: Changing affiliations"

	<https://www.iab.org/wp-content/IAB-uploads/2021/11/Doty.pdf>
	[ANALYZING-AFFILIATIONS]	[ANALYZING-AFFILIATIONS]


	Don Le, "Analysing IETF Data Position Paper" <https://www.iab.org/wp-	Don Le, "Analysing IETF Data Position Paper" [ANALYSING-IETF]
	content/IAB-uploads/2021/11/Le.pdf> [ANALYSING-IETF]


	Elizaveta Yachmeneva, "Research Proposal" <https://www.iab.org/wp-	Elizaveta Yachmeneva, "Research Proposal" [RESEARCH-PROPOSAL]
	content/IAB-uploads/2021/11/Yachmeneva.pdf> [RESEARCH-PROPOSAL]

	4.3. Community and Diversity	4.3. Community and Diversity


	Priyanka Sinha, Michael Ackermann, Pabitra Mitra, Arvind Singh, Amit	Priyanka Sinha, Michael Ackermann, Pabitra Mitra, Arvind Singh, and
	Kumar Agrawal, "Characterizing the IETF through its consensus	Amit Kumar Agrawal, "Characterizing the IETF through its consensus
	mechanisms" <https://www.iab.org/wp-content/IAB-uploads/2021/11/	mechanisms" [CONSENSUS-MECHANISMS]
	Sinha.pdf> [CONSENSUS-MECHANISMS]

	Mallory Knodel, "Would feminists have built a better internet?"	Mallory Knodel, "Would feminists have built a better internet?"

	<https://www.iab.org/wp-content/IAB-uploads/2021/11/Knodel.pdf>
	[FEMINIST-INTERNET]	[FEMINIST-INTERNET]


	Wes Hardaker, Genevieve Bartlett, "Identifying temporal trends in	Wes Hardaker and Genevieve Bartlett, "Identifying temporal trends in
	IETF participation" <https://www.iab.org/wp-content/IAB-	IETF participation" [TEMPORAL-TRENDS]
	uploads/2021/11/Hardaker.pdf> [TEMPORAL-TRENDS]

	Lars Eggert, "Who is the Average IETF Participant?"	Lars Eggert, "Who is the Average IETF Participant?"

	<https://www.iab.org/wp-content/IAB-uploads/2021/11/Eggert.pdf>
	[AVERAGE-PARTICIPANT]	[AVERAGE-PARTICIPANT]

	Emanuele Tarantino, Justus Baron, Bernhard Ganglmair, Nicola Persico,	Emanuele Tarantino, Justus Baron, Bernhard Ganglmair, Nicola Persico,

	Timothy Simcoe, "Representation is Not Sufficient for Selecting	and Timothy Simcoe, "Representation is Not Sufficient for Selecting
	Gender Diversity" <https://www.iab.org/wp-content/IAB-	Gender Diversity" [GENDER-DIVERSITY]
	uploads/2021/11/Tarantino.pdf> [GENDER-DIVERSITY]

	4.4. Publications, Process, and Decision Making	4.4. Publications, Process, and Decision Making


	Michael Welzl, Carsten Griwodz, Safiqul Islam, "Understanding	Michael Welzl, Carsten Griwodz, and Safiqul Islam, "Understanding
	Internet Protocol Design Decisions" <https://www.iab.org/wp-content/	Internet Protocol Design Decisions" [DESIGN-DECISIONS]
	IAB-uploads/2021/11/Welzl.pdf> [DESIGN-DECISIONS]


	Ignacio Castro et al, "Characterising the IETF through the lens of	Ignacio Castro et al., "Characterising the IETF through the lens of
	RFC deployment" <https://dl.acm.org/doi/abs/10.1145/3487552.3487821>	RFC deployment" [RFC-DEPLOYMENT]
	[RFC-DEPLOYMENT]


	Carsten Griwodz, Safiqul Islam, Michael Welzl, "The Impact of	Carsten Griwodz, Safiqul Islam, and Michael Welzl, "The Impact of
	Continuity" <https://www.iab.org/wp-content/IAB-uploads/2021/11/	Continuity" [CONTINUITY]
	Griwodz.pdf> [CONTINUITY]


	Paul Hoffman, "RFCs Change" <https://www.iab.org/wp-content/IAB-	Paul Hoffman, "RFCs Change" [RFCs-CHANGE]
	uploads/2021/11/Hoffman.pdf> [RFCs-CHANGE]


	Xue Li, Sara Magliacane, Paul Groth, "The Challenges of Cross-	Xue Li, Sara Magliacane, and Paul Groth, "The Challenges of
	Document Coreference Resolution in Email" <https://www.iab.org/wp-	Cross-Document Coreference Resolution in Email"
	content/IAB-uploads/2021/11/Groth.pdf> [CROSS-DOC-COREFERENCE]	[CROSS-DOC-COREFERENCE]

	Amelia Andersdotter, "Project in time series analysis: e-mailing	Amelia Andersdotter, "Project in time series analysis: e-mailing

	lists" <https://www.iab.org/wp-content/IAB-uploads/2021/11/	lists" [E-MAILING-LISTS]
	Andersdotter.pdf> [E-MAILING-LISTS]


	Mark McFadden, "A Position Paper by Mark McFadden"	Mark McFadden, "A Position Paper by Mark McFadden" [POSITION-PAPER]
	<https://www.iab.org/wp-content/IAB-uploads/2021/11/McFadden.pdf>
	[POSITION-PAPER]

	4.5. Environmental Sustainability	4.5. Environmental Sustainability

	Christoph Becker, "Towards Environmental Sustainability with the	Christoph Becker, "Towards Environmental Sustainability with the

	IETF" <https://www.iab.org/wp-content/IAB-uploads/2021/11/Becker.pdf>	IETF" [ENVIRONMENTAL]
	[ENVIRONMENTAL]

	Daniel Migault, "CO2eq: Estimating Meetings' Air Flight CO2	Daniel Migault, "CO2eq: Estimating Meetings' Air Flight CO2
	Equivalent Emissions: An Illustrative Example with IETF meetings"	Equivalent Emissions: An Illustrative Example with IETF meetings"

	<https://www.iab.org/wp-content/IAB-uploads/2021/11/Migault.pdf>
	[CO2eq]	[CO2eq]

	5. Informative References	5. Informative References

	[ANALYSING-IETF]	[ANALYSING-IETF]
	Article 19, "Analysing IETF Position Paper",	Article 19, "Analysing IETF Position Paper",
	<https://www.iab.org/wp-content/IAB-uploads/2021/11/	<https://www.iab.org/wp-content/IAB-uploads/2021/11/
	Le.pdf>.	Le.pdf>.

	[ANALYZING-AFFILIATIONS]	[ANALYZING-AFFILIATIONS]

	skipping to change at line 783 ¶	skipping to change at line 752 ¶
	supported in part by the UK Engineering and Physical Sciences	supported in part by the UK Engineering and Physical Sciences
	Research Council under grant EP/S036075/1.	Research Council under grant EP/S036075/1.

	Authors' Addresses	Authors' Addresses

	Niels ten Oever	Niels ten Oever
	University of Amsterdam	University of Amsterdam
	Email: mail@nielstenoever.net	Email: mail@nielstenoever.net

	Corinne Cath	Corinne Cath

		University of Cambridge
	Email: corinnecath@gmail.com	Email: corinnecath@gmail.com

	Mirja Kühlewind	Mirja Kühlewind
	Ericsson	Ericsson
	Email: mirja.kuehlewind@ericsson.com	Email: mirja.kuehlewind@ericsson.com

	Colin Perkins	Colin Perkins
	University of Glasgow	University of Glasgow
	Email: csp@csperkins.org	Email: csp@csperkins.org

End of changes. 29 change blocks.
	78 lines changed or deleted	48 lines changed or added
This html diff was produced by rfcdiff 1.48.