Can I restrict access to the saved emails and attachments?

Yes, the saved emails and attachments are stored in your Google Drive, and you can control access via Drive settings.