This is one of the main focuses ongoing research. It’s nuanced so there is not likely to be a “tada here is the answer” in some global sense, but we’re using numerical experiments to explore the way certain time dependent rules can result in different characteristics for the metric over time:
the thing that makes this research interesting and challenging is that you are computing a metric over a time varying graph, graphs sufficient complex objects that continuous metrics still change in unintuitive ways as they evolve in time.
@ryanMorton @s_ben :
Here are some snaps from the report to demonstrate even the basic pagerank algorithm changing overtime given a relatively simple graph formation process.
Graph forms iteratively:
Summary of graph growth
PageRank calculation for each user
Graph contains both users and contributions by users but the below contains on the users cred. The seed for the graph formation was a subgraph of GitHub - sourcecred/research: Repository for research-related items on SourceCred's agenda which is where the real user names come from. For more of a dive into the research, feel free to jump into the “Temporal Context” Section, “Computational Experiments” subsection of the report.
There will be contributed research on this topic for sure. At the moment, working on collecting, digesting refining the work to date. I plan to write a medium article on this topic based on the research to distill it further. I will post a draft on discourse for feedback before it goes out.