According to Osho, your unrest comes from identifying with the extrovert 'doer' and repressing its introvert opposite. Meditation is not introversion; it is witnessing both without choosing. Become the watcher—neither doing nor deliberately not-doing. Then the egoic doer naturally subsides, action flows without tension, and silence no longer threatens you. Beyond mind, you can use action and rest as tools, relaxing equally in both.
Don’t fight your busy side or hide in quiet; just watch both, and then doing feels easy and resting feels safe.