Combine Amazon Bedrock Information Bases with Microsoft SharePoint as an information supply

Amazon Bedrock Information Bases offers basis fashions (FMs) and brokers in Amazon Bedrock contextual data out of your firm’s non-public information sources for Retrieval Augmented Era (RAG) to ship extra related, correct, and customised responses. Amazon Bedrock Information Bases affords a completely managed RAG expertise.

The information sources that may be linked to as data bases are repeatedly increasing. This submit showcases how one can use one of many information supply connectors; Microsoft SharePoint, an built-in content material administration and collaboration device that many organizations use for storing, organizing, and sharing their inner information. See Information supply connectors for the total record of supported information supply connectors.

Answer overview

The next are some pertinent options of the SharePoint information supply inside Amazon Bedrock Information Bases:

• It offers entry to the data saved in SharePoint. The RAG structure queries and retrieves related data from the SharePoint supply to supply contextual responses primarily based on the consumer’s enter.
• It offers the flexibility to extract structured information, metadata, and different data from paperwork ingested from SharePoint to supply related search outcomes primarily based on the consumer question.
• It offers the flexibility to sync incremental SharePoint content material updates on an ongoing foundation.
• It offers supply attribution to the response generated by the FM.

Within the following sections, we stroll by means of the steps to create a data base, configure your information supply, and check the answer.

Conditions

The next are the stipulations essential to implement Amazon Bedrock Information Bases with SharePoint as a connector:

Create a data base and connect with the info supply

Full the next steps to arrange a data base on Amazon Bedrock and connect with a SharePoint information supply:

1. On the Amazon Bedrock console, select Information bases within the navigation pane.
2. Select Create data base.

3. Within the Information base particulars part, optionally change the default title and enter an outline on your data base.
4. Within the IAM permissions part, choose an IAM position that gives Amazon Bedrock permission to entry different AWS companies. You may let Amazon Bedrock create the service position or select a customized position that you’ve got created.
5. Within the Select information supply part, choose SharePoint.
6. Optionally, add tags to your data base. For extra data, see Tag assets.
7. Select Subsequent.

8. Within the Identify and Description part, optionally change the default information supply title and enter an outline of the info supply.
9. Within the Supply part, present the next data:
   1. For Web site URLs, enter the location URLs to make use of for crawling and indexing the content material for RAG.
   2. For Area, enter the area title related to the info supply. For instance, if the location URL is https://deloittedasits.sharepoint.com/xyz.aspx, the area worth could be deloittedasits.
   3. Below Superior settings, maintain the default alternatives.

Whereas changing your information into embeddings, Amazon Bedrock encrypts your information with a key that AWS owns and manages by default. To make use of your individual AWS Key Administration Service (AWS KMS) key, select Customise encryption settings (Superior) and select a key. For extra data, see Encryption of transient information storage throughout information ingestion.

It’s also possible to select from the next choices for the info deletion coverage on your information supply:

• Delete – Deletes all underlying information belonging to the info supply from the vector retailer upon deletion of a data base or information supply useful resource. Notice that the vector retailer itself is just not deleted, solely the underlying information. This flag is ignored if an AWS account is deleted.
• Retain – Retains all underlying information in your vector retailer upon deletion of a data base or information supply useful resource.

For extra data on managing your data base, see Handle an information supply.

10. Within the Authentication part, the supported authentication methodology is ready to OAuth 2.0.
    1. For Tenant ID, enter your tenant ID. Confer with part Register a brand new utility within the Microsoft Azure Portal of this submit to get the Tenant ID.
    2. For AWS Secrets and techniques Supervisor secret, enter an AWS Secrets and techniques Supervisor Confer with the part Create a Secrets and techniques Supervisor secret for the SharePoint information supply of this submit to get the key.

The SharePoint information supply will want credentials to hook up with the SharePoint On-line web site utilizing the Microsoft Graph API. To facilitate this, create a brand new Secrets and techniques Supervisor secret. These credentials won’t be utilized in any entry logs for the SharePoint On-line Web site.

11. Within the Metadata Settings part, optionally choose any content material sorts that you simply need to embrace or exclude.

12. Within the Content material chunking and parsing part, choose Default.

13. Select Subsequent.
14. Within the Embeddings mannequin part, choose Titan Embeddings G1 – Textual content or one other embeddings mannequin as acceptable.
15. Within the Vector database part, choose Fast create a brand new vector retailer to create a vector retailer for the embeddings.
16. Select Subsequent.

17. On the Evaluate and create web page, confirm the alternatives you made and select Create.

The data base creation ought to be full.

The data base with SharePoint as the info supply is now created. Nevertheless, the info supply must be synced so as to crawl the location URLs and index the related content material.

18. To provoke this course of, on the data base particulars web page, choose your information supply and select Sync.

Register a brand new utility within the Microsoft Azure Portal

On this part, we register a brand new utility within the Microsoft Azure Portal. We seize the Tenant ID from this step to make use of when configuring the info supply for Information Base for Amazon Bedrock. Full the next steps:

1. Open the Azure Portal and log in along with your Microsoft account. In case you don’t have an account, you possibly can create one or contact your group’s administration crew.
2. Select New registration.
3. Present the next data:
   1. For Identify, present the title on your utility. Let’s discuss with this utility as TargetApp. Amazon Bedrock Information Bases makes use of TargetApp to hook up with the SharePoint web site to crawl and index the info.
   2. For Who can use this utility or entry this API, select Accounts on this organizational listing solely ( solely – Single tenant).
   3. Select Register.
   4. Notice down the applying (consumer) ID and the listing (tenant) ID on the Overview You’ll want them later when requested for TargetApp-ClientId and TenantId.
4. Select API permissions within the navigation pane.
5. Configure the permissions as follows:
   1. Select Add a permission.
   2. Select Microsoft Graph.
   3. Select Delegated permissions.
   4. Select Learn.All within the Consumer part.
   5. Select Learn.All within the GroupMember part.
   6. Select FullControl.All within the Websites part.
   7. Select Add permissions. This permission permits the app to learn information in your group’s listing in regards to the signed-in consumer.
   8. On the choices menu (three dots), select Take away permission.
   9. Take away the unique Learn – Delegated permission.
   10. Select Grant admin consent for the default listing.

6. Select Certificates & secrets and techniques within the navigation pane.
   1. Select New consumer secret.
   2. For Description, enter an outline, akin to description of my consumer secret.
   3. Select a worth for Expires. In manufacturing, you’ll must manually rotate your secret earlier than it expires.
   4. Select Add.
   5. Notice down the worth on your new secret. You’ll want it later when requested on your consumer secret (TargetApp-ClientSecret).
7. Optionally, select Homeowners so as to add any extra homeowners for the applying. Homeowners will be capable of handle permissions of the Azure AD app (TargetApp).

Create a Secrets and techniques Supervisor secret for the SharePoint information supply

Full the next steps to create a Secrets and techniques Supervisor secret to hook up with the SharePoint on-line websites listed as web site URLs inside the information supply:

1. On the Secrets and techniques Supervisor console, select Retailer a brand new secret.
2. For Secret sort, choose Different sort of secret.
3. For Key/worth pairs, enter the next:
   1. username
   2. password
   3. clientId
   4. clientSecret
4. For Encryption key, select aws/secretsmanager.
5. Select Subsequent.
6. Within the Secret title and outline part, enter the title of the key and an non-compulsory description.
7. Add any related tags within the Tags
8. Go away Useful resource permissions and Replication secret as default.
9. Select Subsequent.
10. Within the Configure rotation part, go away as default or modify in accordance with your organizational insurance policies.
11. Select Subsequent.
12. Evaluate the choices you chose and select Retailer.
13. On the secrets and techniques element web page, word your secret ARN worth for use as the key when creating the Information Base for Amazon Bedrock.

Check the answer

Full the next steps to check the data base you created:

1. On the Amazon Bedrock console, select Information bases within the navigation pane.
2. Choose the data base you created and select Check.

3. Select an acceptable mannequin for testing and select Apply.

4. Enter your query for the content material housed within the SharePoint web site.

Clear up

In case you created a brand new data base to experiment utilizing this submit and don’t plan to make use of it additional, delete the data base in order that your AWS account doesn’t accumulate prices. For directions, see Handle a data base.

Conclusion

On this submit, we confirmed you how one can configure Amazon Bedrock Information Bases with SharePoint On-line as an information supply. By connecting SharePoint On-line as an information supply, workers can work together with the group’s data and information saved in SharePoint utilizing pure language, making it simple to seek out related data, extract key factors, and derive beneficial insights. This could considerably enhance productiveness, decision-making, and data sharing inside the group.

Do this characteristic on the Amazon Bedrock console at present! See Amazon Bedrock Information Bases to be taught extra.

In regards to the Authors

Surendar Gajavelli is a Sr. Options Architect primarily based out of Nashville, Tennessee. He’s a passionate know-how fanatic who enjoys working with clients and serving to them construct revolutionary options.

Abhi Patlolla is a Sr. Options Architect primarily based out of the New York Metropolis area, serving to clients of their cloud transformation, AI/ML, and information initiatives. He’s a strategic and technical chief, advising executives and engineers on cloud methods to foster innovation and optimistic impression.