Skip to content

[GSoC] Insights dashboard (Part 1) - #2391

Open
Samk1710 wants to merge 12 commits into
aboutcode-org:mainfrom
Samk1710:gsoc-insights-dashboard
Open

[GSoC] Insights dashboard (Part 1)#2391
Samk1710 wants to merge 12 commits into
aboutcode-org:mainfrom
Samk1710:gsoc-insights-dashboard

Conversation

@Samk1710

@Samk1710 Samk1710 commented Jul 24, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Closes:

Summary:

  1. Registers the Insights App
  2. Add charts and models for the above mentioned panels
  3. Add Snapshot Pipeline
  4. Add Insights Dashboard UI
  5. Add related tests

The Overview and Data Quality Panel will be added in a succeeding PR.

Insights Snapshot Improver Logs

python manage.py improve insights_snapshot
Improving data using insights_snapshot
INFO 2026-07-29 18:11:07.883824 UTC Pipeline [InsightsSnapshotPipeline] starting
INFO 2026-07-29 18:11:07.884066 UTC Step [compute_chart_analytics] starting
INFO 2026-07-29 18:11:08.064396 UTC Running collect_fn for pkg-dist-donut
INFO 2026-07-29 18:11:08.064670 UTC Progress: 5% (1/19)
INFO 2026-07-29 18:11:09.372010 UTC Running collect_fn for pkg-name-donut
INFO 2026-07-29 18:11:09.372377 UTC Progress: 10% (2/19) ETA: 12 seconds
INFO 2026-07-29 18:11:09.428578 UTC Progress: 15% (3/19) ETA: 8 seconds
INFO 2026-07-29 18:11:09.512689 UTC Progress: 21% (4/19) ETA: 5 seconds
INFO 2026-07-29 18:11:11.898967 UTC Progress: 26% (5/19) ETA: 11 seconds
INFO 2026-07-29 18:11:11.911428 UTC Progress: 31% (6/19) ETA: 9 seconds
INFO 2026-07-29 18:11:13.192917 UTC Progress: 36% (7/19) ETA: 9 seconds
INFO 2026-07-29 18:11:13.594430 UTC Progress: 42% (8/19) ETA: 8 seconds
INFO 2026-07-29 18:11:13.778893 UTC Progress: 47% (9/19) ETA: 6 seconds
INFO 2026-07-29 18:11:13.784304 UTC Progress: 52% (10/19) ETA: 5 seconds
INFO 2026-07-29 18:11:13.834455 UTC Progress: 57% (11/19) ETA: 4 seconds
INFO 2026-07-29 18:11:16.781553 UTC Progress: 63% (12/19) ETA: 5 seconds
INFO 2026-07-29 18:11:22.465685 UTC Progress: 68% (13/19) ETA: 7 seconds
INFO 2026-07-29 18:11:23.547307 UTC Progress: 73% (14/19) ETA: 6 seconds
INFO 2026-07-29 18:11:25.941542 UTC Progress: 78% (15/19) ETA: 5 seconds
INFO 2026-07-29 18:11:28.616256 UTC Running collect_fn for pkg-cwe-bar
INFO 2026-07-29 18:11:28.616573 UTC Progress: 84% (16/19) ETA: 4 seconds
INFO 2026-07-29 18:11:29.408454 UTC Running collect_fn for severity-scatter-plot
INFO 2026-07-29 18:11:29.408660 UTC Progress: 89% (17/19) ETA: 3 seconds
INFO 2026-07-29 18:11:32.073946 UTC Running collect_fn for importer-empty-pkg-bar
INFO 2026-07-29 18:11:32.074142 UTC Progress: 94% (18/19) ETA: 2 seconds
INFO 2026-07-29 18:12:17.456192 UTC Running collect_fn for importer-exploit-bar
INFO 2026-07-29 18:12:17.456385 UTC Progress: 100% (19/19)
INFO 2026-07-29 18:12:17.456466 UTC Step [compute_chart_analytics] completed in 70 seconds (1.2 minutes)
INFO 2026-07-29 18:12:17.456527 UTC Step [save_snapshot] starting
INFO 2026-07-29 18:12:17.456651 UTC Saving snapshot
INFO 2026-07-29 18:12:17.510673 UTC Snapshot saved successfully.
INFO 2026-07-29 18:12:17.515772 UTC Step [save_snapshot] completed in 0 seconds
INFO 2026-07-29 18:12:17.515975 UTC Pipeline completed in 70 seconds (1.2 minutes)

@Samk1710

Samk1710 commented Jul 24, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor Author

Package Panel
image

image

Severity Panel

image image

Importer Panel
image
image

@Samk1710
Samk1710 force-pushed the gsoc-insights-dashboard branch 5 times, most recently from a51b8a3 to ed54440 Compare July 29, 2026 18:09
@Samk1710
Samk1710 marked this pull request as ready for review July 29, 2026 18:09
@Samk1710

Samk1710 commented Jul 29, 2026

Copy link
Copy Markdown
Contributor Author

This PR is ready for review. Do take a look!
CC: @keshav-space @ziadhany @TG1999 @Hritik14

@Samk1710
Samk1710 force-pushed the gsoc-insights-dashboard branch 3 times, most recently from 727219f to 20f356c Compare August 11, 2026 21:37
@Samk1710 Samk1710 changed the title [GSoC] 1: Insights dashboard [GSoC] Insights dashboard (Part 1) Aug 11, 2026
@Samk1710 Samk1710 mentioned this pull request Aug 11, 2026
Open
ziadhany
ziadhany requested changes Aug 17, 2026
View reviewed changes

@ziadhany ziadhany left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@Samk1710 The code looks good. We just need to refactor it a bit. I’ve left a few comments there, so please take a look.

Comment thread vulnerabilities/templates/navbar.html Outdated
Comment thread vulnerabilities/improvers/__init__.py Outdated
Comment thread insights/charts/package_panel.py
return data


# Top CWE Distribution

@ziadhany ziadhany Aug 17, 2026

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
# Top CWE Distribution

@Samk1710 Samk1710 Aug 18, 2026

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I feel we should keep this as it separates the blocks code of the various charts.

Comment thread insights/utils.py Outdated
Comment thread insights/models.py Outdated
Comment thread insights/charts/__init__.py
@Samk1710 Samk1710 mentioned this pull request Aug 17, 2026
Open
Samk1710 added 12 commits August 19, 2026 00:46
@Samk1710
Setup Insights App
4b87aa0 
Signed-off-by: Sampurna Pyne <sampurnapyne1710@gmail.com>
@Samk1710
Add models for insights and migration script
9ea3649 
Signed-off-by: Sampurna Pyne <sampurnapyne1710@gmail.com>
@Samk1710
Add charts for Package, Severity and Importer Panel
9670231 
Signed-off-by: Sampurna Pyne <sampurnapyne1710@gmail.com>
@Samk1710
Register the snapshot pipeline
44c8ae1 
Signed-off-by: Sampurna Pyne <sampurnapyne1710@gmail.com>
@Samk1710
Add views and routes for inisghts
fdd1abd 
Signed-off-by: Sampurna Pyne <sampurnapyne1710@gmail.com>
@Samk1710
Add billboard chart
a72e538 
Signed-off-by: Sampurna Pyne <sampurnapyne1710@gmail.com>
@Samk1710
Add panel specific js renderers
a798b4b 
Signed-off-by: Sampurna Pyne <sampurnapyne1710@gmail.com>
@Samk1710
Add Dashboard UI
44a9183 
Signed-off-by: Sampurna Pyne <sampurnapyne1710@gmail.com>
@Samk1710
Add tests
8a5ac28 
Signed-off-by: Sampurna Pyne <sampurnapyne1710@gmail.com>
@Samk1710
Improve UI for Importer Panel Charts
48b4c51 
Signed-off-by: Sampurna Pyne <sampurnapyne1710@gmail.com>
@Samk1710
Use horizontal bar for Top Packages
478b2d7 
Signed-off-by: Sampurna Pyne <sampurnapyne1710@gmail.com>
@Samk1710
Remove formatter function for importer_name
b6448af 
Signed-off-by: Sampurna Pyne <sampurnapyne1710@gmail.com>
@Samk1710
Samk1710 force-pushed the gsoc-insights-dashboard branch from 1e4a115 to b6448af Compare August 18, 2026 19:16
@Samk1710

Samk1710 commented Aug 18, 2026

Copy link
Copy Markdown
Contributor Author

@ziadhany Thanks for the review. I have applied your suggestions.

@Samk1710
Samk1710 requested a review from ziadhany August 18, 2026 19:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@ziadhany ziadhany Awaiting requested review from ziadhany

Requested changes must be addressed to merge this pull request.

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@Samk1710 @ziadhany