OpenShift GitOps is failing to sync with "application refresh deadline exceeded" error message

Issue

• One of our developers would like to use ArgoCD for their applications. One ArgoCD applications holds about 196 resources which we know are a lot but the product needs all these resources in this specific namespace. When syncing or refresh the resources they get from time to time the below error.

  time="2022-04-05T13:14:47Z" level=error msg="finished unary call with code Unknown" error="application refresh deadline exceeded" grpc.code=Unknown grpc.method=Get grpc.service=application.ApplicationService grpc.start_time="2022-04-05T13:14:17Z" grpc.time_ms=30001.477 span.kind=server system=grpc
  

• When syncing a large git repository in GitOps it sometimes is failing with the below error reported in argocd-repo-server pod.

  2022-04-06T09:04:26.706552890Z time="2022-04-06T09:04:26Z" level=error msg="finished unary call with code Unknown" error="`helm template . --name-template foo --namespace bar-foo --kube-version 1.21 --values /tmp/https___git.example.com_abc/def/values.yaml --api-versions admissionregistration.k8s.io/v1 [...] --api-versions whereabouts.cni.cncf.io/v1alpha1/OverlappingRangeIPReservation --include-crds` failed timeout after 1m30s" grpc.code=Unknown grpc.method=GenerateManifest grpc.request.deadline="2022-04-06T09:02:04Z" grpc.service=repository.RepoServerService grpc.start_time="2022-04-06T09:01:04Z" grpc.time_ms=202568.5 span.kind=server system=grpc