Skip to content

Commit

Permalink
Update
Browse files Browse the repository at this point in the history
  • Loading branch information
yunwei37 committed Sep 18, 2024
1 parent 78c3640 commit 3fbb58a
Show file tree
Hide file tree
Showing 10 changed files with 13,324 additions and 4 deletions.
232 changes: 232 additions & 0 deletions data/commit_survey.csv

Large diffs are not rendered by default.

20 changes: 16 additions & 4 deletions docs/report_ebpf.md
Original file line number Diff line number Diff line change
Expand Up @@ -21,6 +21,17 @@ In this section, we apply the *Code-survey* methodology to analyze the evolution
- [Merge Commit Correctness](#merge-commit-correctness)
- [Not Related to the BPF Subsystem](#not-related-to-the-bpf-subsystem)
- [Consistency Across Similar Questions](#consistency-across-similar-questions)
- [Example 1: Merge Commits](#example-1-merge-commits)
- [Example 2: Unrelated Components](#example-2-unrelated-components)
- [The timeline analysis of commits](#the-timeline-analysis-of-commits)
- [Commit Classification Over Time](#commit-classification-over-time)
- [Commit related to Major Implementation Component Over Time](#commit-related-to-major-implementation-component-over-time)
- [Commit related to Major Logic Component Over Time](#commit-related-to-major-logic-component-over-time)
- [Use cases or events Over Time](#use-cases-or-events-over-time)
- [Commit Complexity Over Time](#commit-complexity-over-time)
- [Deeper insight Analysis](#deeper-insight-analysis)
- [Verifier bugs or features related to eBPF Instruction](#verifier-bugs-or-features-related-to-ebpf-instruction)
- [The evolution and status of libbpf](#the-evolution-and-status-of-libbpf)
- [Coverage of Survey Questions](#coverage-of-survey-questions)
- [Clarity and Ambiguity in Responses](#clarity-and-ambiguity-in-responses)
- [Alignment with Real-World Changes](#alignment-with-real-world-changes)
Expand Down Expand Up @@ -410,7 +421,7 @@ Sample Commit Messages of 'Not related to BPF subsystem' in Implementation Compo
- **Data Correction:** Unrelated commits can be excluded by refining the filtering criteria after processing and before analysis. Manual review can also help identify and remove irrelevant commits
- **Conclusion:** The presence of commits not related to the BPF subsystem is due to the broad filtering method. By adjusting the filtering approach, we can exclude unrelated data and improve the accuracy of our analysis.

### Consistency Across Similar Questions
## Consistency Across Similar Questions


- Are similar questions answered consistently across different but related features or subsystems?
Expand All @@ -424,14 +435,14 @@ We looked for alignment in responses to assess consistency. In cases where incon

See the generated `distribute.txt` as example, we have 10000+ commits:

#### Example 1: Merge Commits
### Example 1: Merge Commits

- **Commit Classification:** "It's like a merge commit." (1,347 responses)
- **Commit Complexity:** "Merge-like. The commit merges branches." (1,346 responses)

Responses were nearly identical, showing high consistency in identifying merge commits.

#### Example 2: Unrelated Components
### Example 2: Unrelated Components

- **Implementation Component:** "Not related to BPF. A rare case of wrong data." (606 responses)
- **Logic Component:** "Not related to BPF. A rare case of wrong data." (602 responses)
Expand Down Expand Up @@ -477,7 +488,6 @@ In this step, we:

In this section, we will delve deeper into the survey responses to identify patterns, trends, and potential areas for improvement.


### Verifier bugs or features related to eBPF Instruction

By analyzing the survey responses related to the eBPF verifier, we can gain insights into the prevalence of bugs and features related to the instruction set.
Expand All @@ -486,6 +496,8 @@ By analyzing the survey responses related to the eBPF verifier, we can gain insi

### The evolution and status of libbpf

What identifiable phases exist in a component lifecycle, such as libbpf?

![imgs/timeline_libbpf_commit_classification_smoothed.png](../imgs/timeline_libbpf_commit_classification_smoothed.png)

## Coverage of Survey Questions
Expand Down
Binary file modified imgs/instruction_verifier_features_bugs_over_time.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified imgs/timeline_commit_classification_smoothed.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified imgs/timeline_commit_complexity_smoothed.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified imgs/timeline_libbpf_commit_classification_smoothed.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified imgs/timeline_major_related_implementation_component_smoothed.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified imgs/timeline_major_related_logic_component_smoothed.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified imgs/timeline_usecases_or_submodule_events_smoothed.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
13,076 changes: 13,076 additions & 0 deletions output_commit_survey1.txt

Large diffs are not rendered by default.

0 comments on commit 3fbb58a

Please sign in to comment.