feat: implement job metadata service and integrate with backend job management systems