Journal Configurations

At the end of the research workflow, the Researcher has either decided to discard his research, or, is preparing to submit his final submission to the Journal. At this point, he passes his manuscript to the Journal, and thereafter he will have no control over its destiny anymore.

Journal module is designed to simulate the reviewing process. After receiving the submission (ie. Manuscript) from the Researcher, the Journal asses the quality of the research and decide on whether to accept or reject the submission. Journal’s assessment is being conducted using a group of pre-defined algorithms, referred to as Selection Strategies.

Figure 1. Journal’s Reviewing Workflow

Figure 1 shows the steps taken by the Journal during the review process. The Journal starts by querying the selection strategy for its verdict on whether the quality of the given submission. For example, a selection strategy that’s designed to mimic publication bias might base its decision on availability of positive significant effect, and therefore reject 95% of non-significant results.

If selection strategy approves the “quality” of the submission, submission will be accepted and stored in a database of accepted submissions, a.k.a, publications list. In contrast, rejected outcomes will not be published and stored in rejected submissions list. At the end of the simulation, journal may export any or all of these lists as CSV files for further analysis.

Journal parameters are in general less elaborate than other modules and are divided into two main sections, Selection Strategy and Meta Analysis.

• max_pubs, integer, Indicates the maximum number of publications that is going to be accepted by Journal.
• selection_strategy, object, Indicates the specification of the Selection Strategy.

• meta_analysis_metrics, list, List of meta analysis methods together with their corresponding parameters.

• TODO: Explain the example below!

Journal's Configurations

    "journal_parameters": {
    "max_pubs": 24,
    "selection_strategy": {
        "name": "SignificantSelection",
        "alpha": 0.005,
        "pub_bias": 0.2,
        "side": 0
    },
    "meta_analysis_metrics": [
        {
            "name": "FixedEffectEstimator"
        },
        {
            "name": "RandomEffectEstimator",
            "estimator": "DL"
        },
        {
            "name": "EggersTestEstimator",
            "alpha": 0.1
        }
    ]

---

Last update: 2021-09-18