Try showing them visually, as they build the restriction and exemption times. With each criterion added, the timeline updates.

I'm not sure I fully understand your use case, but it sounds like users need to clearly see the results of their restrictions and exceptions. I'm focusing a little bit on how to see the outcome as feedback.

Forcing them to read and calculate dates (and proportional allocations) seems to add to their workload. They also might have to look at periods across each criterion as well.

Could you have a visualization that aids in showing them as they add criteria?

A heatmap example:

Github is an example of showing a years worth of data. At a glance, you can see periods of activity.

Don't make them read; provide visuals in tandem.

If there's another state (i'm not too clear on this): that of unrestricted and undeclared time, the heatmap can show these gaps as well.

I hope I am not misunderstanding your needs, but my recommendation is to do away with the exception/exclusion periods, as they are merely reinstating the default (criterion* applies) in a period of "restriction" (criterion does not apply). Intuitively it might appear simpler to say (as in your 3rd example) "The criterion should apply all year, except for a summer break", but you need two lines to say it, and you might as well say (in the same space, without the mental calisthenics):

Applies from 2019-01-01 to 2019-07-13
Applies from 2019-08-16 to 2019-12-31

To allow insertion of an exception more easily, I would recommend a split (or similarly named) button (in addition to edit and delete), which would double the current line and prefill the start of the first and the end of the second line with the start and end of the original line. A color-coded calendar to help visualize this (as suggested in other answers) would certainly be helpful but is not strictly required.

By the way, your example criterion 1 is simply the equivalent of Applies from -infinity to infinity.

*) "Criteria" is the plural of "criterion" (a standard or a trait) or of "criterium" (a bike race).

Overlap of rules

I apologize if I misunderstood the ASK, but I feel this is a classic case of AND & OR operations (kind of :P).

1. Users add a rule (set up time period) i.e Application


2. Users can add another rule on top of the above rule i.e Exception, which may or may not overlap with the set time period.

Since the application and exception are closely tied to the mental map when creating, instead of giving them separate hierarchies I feel they should have parent/child relationship.

My proposal

I love how Zapier visualizes the AND/OR operations.

In close to the above design, your interface can look like

Instead of placing action buttons at the bottom, place "Add" buttons in each section.

Applies:
From 2019-01-01 to 2019-12-31 edit delete

+ Add

Except:
From 2019-07-14 to 2019-08-15 edit delete

+ Add

Usually simplifying the copy language helps (something like "add valid time range" & "block specific dates".

A second option would be adding colors such as green (for restricted times) and red (for exception times), following the logic:

Green => go, Red =>stop

A third option is to add an icon (+ for add, - for restricting).

Best if you do all three together, this makes sure you cover more users' logics (i.e. graphic-oriented vs readers) Try to think of the user as if you were talking to a kid ;) this always helps me!

The problem is that you are presenting the rules, but not the result.

As a litmus test, try to answer the question: is the criterion applied on Mar 23rd?

Instead of:

Applies from 2019-01-01 to 2019-12-31

Except from 2019-07-14 to 2019-08-15

The following display is easier to reason about... especially as exceptions pile up:

Applies from 2019-01-01 to 2019-07-13
Applies from 2019-08-16 to 2019-12-31

It could also be helpful to make this more visual. Calendars would be greatly helpful; especially with clicking to toggle on/off and SHIFT+click or CTRL+click to mass select/unselect.

If space is limited, even with text you could add extra information to help the user:

Applies from 2019-01-01 to 2019-07-13 (x days)
 -- y days later --
Applies from 2019-08-16 to 2019-12-31 (z days)

This order of magnitude check can help the user identifying typos.