{"id":351322,"date":"2024-05-20T12:18:03","date_gmt":"2024-05-20T12:18:03","guid":{"rendered":"http:\/\/savepearlharbor.com\/?p=351322"},"modified":"-0001-11-30T00:00:00","modified_gmt":"-0001-11-29T21:00:00","slug":"","status":"publish","type":"post","link":"https:\/\/savepearlharbor.com\/?p=351322","title":{"rendered":"How to create sound cloud\u00a0platform \u2014 notes<\/span>"},"content":{"rendered":"
<\/div>\n
\n
\n
\n
\n
    \n
  1. \n

    Prerequisite: registered domain name<\/a><\/p>\n

      \n
    1. \n

      Create Route 53\u00a0A record<\/a><\/p>\n<\/li>\n

    2. \n

      Configure ACM certificate in N. Virginia region .example.com<\/em><\/a><\/p>\n<\/li>\n<\/ol>\n<\/li>\n

    3. \n

      Create s3 bucket with website feature to host static files<\/em><\/a><\/p>\n<\/li>\n

    4. \n

      Create Cloudfront distribution and attach ACM cert to it<\/em><\/a><\/p>\n<\/li>\n

    5. \n

      Create Cognito User Pool<\/em><\/a><\/p>\n<\/li>\n

    6. \n

      Attach own domain to Cognito User Pool<\/em><\/a><\/p>\n<\/li>\n

    7. \n

      Inside Cognito User Pool create web app client and Configure redirect URL<\/em><\/a><\/p>\n<\/li>\n

    8. \n

      Create Lambda Function for signup will fetch user image from google\/fb<\/em><\/a><\/p>\n<\/li>\n<\/ol>\n

      It may seem obvious but lambda has to have permission to s3\/dynamodb<\/em><\/a><\/p>\n

      Create API Gateway REST API with Lambda as handler<\/em><\/a><\/p>\n

      don\u2019t forget to enable CORS, attach custom domain<\/em><\/a><\/p>\n

        \n
      1. \n

        Create API Gateway Authorizer<\/em><\/a><\/p>\n<\/li>\n<\/ol>\n

        Create Usage plan<\/em><\/p>\n

        Create Stage<\/em><\/p>\n

        To enable logging you must create IAM role<\/em><\/p>\n

        After processing of the track is finished successfully we send message to dedicated fifo queue.<\/em><\/p>\n

        Outdated tracks(now\u200a\u2014\u200acreated_at < [reasonable time delta] AND status == \u2018preparing\u2019) deleted.<\/code><\/p>\n

          \n
        1. \n

          Create ES domain. Attach policy to access Kibana(in our case from ext acc lambda and from local ip):<\/em><\/a><\/p>\n<\/li>\n<\/ol>\n

          Using AWS to create Sound sharing\u00a0platform<\/h3>\n

          Prerequisite: registered domain\u00a0name<\/h3>\n

          Create Route 53 A\u00a0record<\/h3>\n
          \"Attachment\"<\/p>\n
          Attachment<\/figcaption><\/div>\n<\/figure>\n

          Configure ACM certificate in N. Virginia region .example.com<\/h3>\n

          Create s3 bucket with website feature to host static\u00a0files<\/h3>\n

          Create s3 bucket for avatars\/artworks<\/em><\/p>\n

          \"Attachment\"<\/p>\n
          Attachment<\/figcaption><\/div>\n<\/figure>\n

          Create Cloudfront distribution and attach ACM cert to\u00a0it<\/h3>\n

          Create Cognito User\u00a0Pool<\/h3>\n

          Attach own domain to Cognito User\u00a0Pool<\/h3>\n
          \"Screenshot<\/p>\n
          Screenshot 2021-01-22 at 12.53.03<\/figcaption><\/div>\n<\/figure>\n

          Inside Cognito User Pool create web app client and Configure redirect\u00a0URL<\/h3>\n

          Create Lambda \u00a0signup post confirmation trigger Function it will fetch user image from google\/fb<\/h3>\n

          It may seem obvious but lambda has to have permission to s3\/dynamodb<\/h3>\n

          Create API Gateway REST API with Lambda as\u00a0handler<\/h3>\n

          don\u2019t forget to enable CORS, attach custom\u00a0domain<\/h3>\n
          \"Attachment\"<\/p>\n
          Attachment<\/figcaption><\/div>\n<\/figure>\n

          Create dynamodb users table with sub as partition key<\/h3>\n
          export type User = {  username: string  date_joined: Date  first_name: string  last_name: string  city: string  country: string  description: string  email: string  track_count: number  avatar_url: string  permalink: string}<\/code><\/pre>\n
          Create API Gateway Authorizer<\/h3>\n
          \"Attachment\"<\/p>\n
          Attachment<\/figcaption><\/div>\n<\/figure>\n
          Create Usage\u00a0plan<\/h3>\n
          Create Stage<\/h3>\n
          To enable logging you must create IAM\u00a0role<\/h3>\n
          why did I choose DynamoDB: for example facebook users tend to read but not to post. Keep data ready to read = writing could be more complex<\/em><\/p>\n
          API GW\u200a\u2014\u200aUse id_token, assign api key, usage plan, custom domain path mapping<\/em><\/strong><\/p>\n
          Attach authorizer to appropriate endpoints<\/em><\/p>\n
          \"Attachment\"<\/p>\n
          Attachment<\/figcaption><\/div>\n<\/figure>\n
          \"Attachment\"<\/p>\n
          Attachment<\/figcaption><\/div>\n<\/figure>\n
          Create user pool trigger on Post confirmation event to store user in db\u00a0<\/em>!!!<\/em><\/strong><\/p>\n
          \"Attachment\"<\/p>\n
          Attachment<\/figcaption><\/div>\n<\/figure>\n
          Build FFmpeg with dumpwave-filter patch applied or use prepared lambda package humeniukd\/ffmpeg-lambda.<\/em><\/p>\n
          Create two s3 buckets first for incoming audio and second for storing processed mp3 along with json.<\/em><\/p>\n
          For incoming bucket setup trigger for PUT event to execute wf-lambda function.<\/em><\/p>\n
          Upload policy endpoint for generating presigned s3 url to PUT\/POST new uploads<\/em><\/p>\n
          After processing of the track is finished successfully we send message to dedicated fifo queue. Outdated tracks(now\u200a\u2014\u200acreated_at < [reasonable time delta] AND status == \u2018preparing\u2019) deleted.<\/h3>\n
          Create ES domain. Attach policy to access Kibana(in our case from ext acc lambda and from local\u00a0ip):<\/h3>\n
          {  \"Version\": \"2012\u201310\u201317\",  \"Statement\": [    {      \"Effect\": \"Allow\",      \"Principal\": {        \"AWS\": \"arn:aws:iam::HIDDEN:role\/yes\"      },      \"Action\": \"es:\",      \"Resource\": \"arn:aws:es:eu-central-1: HIDDEN:domain\/ohyo\/\"    },    {      \"Effect\": \"Allow\",      \"Principal\": {        \"AWS\": \"\"      },      \"Action\": \"es:\",      \"Resource\": \"arn:aws:es:eu-central-1: HIDDEN:domain\/ohyo\/*\",      \"Condition\": {        \"IpAddress\": {          \"aws:SourceIp\": \"AA.BB.CC.DD\"        }      }    }  ]}<\/code><\/pre>\n
          Create mapping for tags autocomplete suggested<\/p>\n
          \"Screenshot<\/p>\n
          Screenshot 2021-01-22 at 10.52.53<\/figcaption><\/div>\n<\/figure>\n
          Put tags to new index<\/p>\n
          \"Screenshot<\/p>\n
          Screenshot 2021-01-22 at 10.54.06<\/figcaption><\/div>\n<\/figure>\n
          Create endpoint to retrieve tags for autocompletion<\/p>\n
          \"Screenshot<\/p>\n
          Screenshot 2021-01-22 at 22.30.45<\/figcaption><\/div>\n<\/figure>\n
          Create endpoint to save track metadata<\/p>\n
          Create endpoint to resolve track\/user by permalink<\/p>\n
          To respond with status 404 lambda should throw Error with message text recognised by API Gateway:<\/p>\n
          \"Screenshot<\/p>\n
          Screenshot 2021-01-31 at 15.39.25<\/figcaption><\/div>\n<\/figure>\n
          -Put item to dynamodb(update user)<\/p>\n
          Export API as swagger JSON<\/p>\n
          \"Screenshot<\/p>\n
          Screenshot 2021-02-09 at 22.06.20<\/figcaption><\/div>\n<\/figure>\n
          Generate types on the FE side using yarn generate:types<\/p>\n
          \"Screenshot<\/p>\n
          Screenshot 2021-02-09 at 22.10.05<\/figcaption><\/div>\n<\/figure>\n
          -Refresh ES index for search<\/p>\n
          Configure api gateway template mapping for skipping empty fields<\/p>\n
          Create user stream pagination using user_id as partition key and created_at as sort key<\/p>\n
          If LastEvaluatedKey is present use it for next url query params<\/p>\n
          Set up dynamodb stream to process newly created comments<\/p>\n
          To POST artwork img configure api to accept encodings such as<\/p>\n
          \"Screenshot<\/p>\n
          Screenshot 2021-02-25 at 15.15.17<\/figcaption><\/div>\n<\/figure>\n
            \n
          1. \n
            Go to the API Gateway settings tab for your API and add multipart\/form-data, image\/jpeg to the\u00a0binary media types<\/em>section.<\/p>\n<\/li>\n
          2. \n
            Add Content-Type and Accept to the request headers for your proxy method<\/p>\n<\/li>\n
          3. \n
            Add Access-Control-Allow-Methods to Method Response headers<\/p>\n<\/li>\n
          4. \n
            Re-deploy the API<\/p>\n<\/li>\n<\/ol>\n<\/div>\n<\/div>\n<\/div>\n
            <\/div>\n

             \u0441\u0441\u044b\u043b\u043a\u0430 \u043d\u0430 \u043e\u0440\u0438\u0433\u0438\u043d\u0430\u043b \u0441\u0442\u0430\u0442\u044c\u0438  https:\/\/habr.com\/ru\/articles\/752650\/<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"
            <\/div>\n
            \n
            \n
            \n
            \n
              \n
            1. \n
              Prerequisite: registered domain name<\/a><\/p>\n
                \n
              1. \n
                Create Route 53\u00a0A record<\/a><\/p>\n<\/li>\n
              2. \n
                Configure ACM certificate in N. Virginia region .example.com<\/em><\/a><\/p>\n<\/li>\n<\/ol>\n<\/li>\n
              3. \n
                Create s3 bucket with website feature to host static files<\/em><\/a><\/p>\n<\/li>\n
              4. \n
                Create Cloudfront distribution and attach ACM cert to it<\/em><\/a><\/p>\n<\/li>\n
              5. \n
                Create Cognito User Pool<\/em><\/a><\/p>\n<\/li>\n
              6. \n
                Attach own domain to Cognito User Pool<\/em><\/a><\/p>\n<\/li>\n
              7. \n
                Inside Cognito User Pool create web app client and Configure redirect URL<\/em><\/a><\/p>\n<\/li>\n
              8. \n
                Create Lambda Function for signup will fetch user image from google\/fb<\/em><\/a><\/p>\n<\/li>\n<\/ol>\n
                It may seem obvious but lambda has to have permission to s3\/dynamodb<\/em><\/a><\/p>\n
                Create API Gateway REST API with Lambda as handler<\/em><\/a><\/p>\n
                don\u2019t forget to enable CORS, attach custom domain<\/em><\/a><\/p>\n
                  \n
                1. \n
                  Create API Gateway Authorizer<\/em><\/a><\/p>\n<\/li>\n<\/ol>\n
                  Create Usage plan<\/em><\/p>\n
                  Create Stage<\/em><\/p>\n
                  To enable logging you must create IAM role<\/em><\/p>\n
                  After processing of the track is finished successfully we send message to dedicated fifo queue.<\/em><\/p>\n
                  Outdated tracks(now\u200a\u2014\u200acreated_at < [reasonable time delta] AND status == \u2018preparing\u2019) deleted.<\/code><\/p>\n
                    \n
                  1. \n
                    Create ES domain. Attach policy to access Kibana(in our case from ext acc lambda and from local ip):<\/em><\/a><\/p>\n<\/li>\n<\/ol>\n
                    Using AWS to create Sound sharing\u00a0platform<\/h3>\n
                    Prerequisite: registered domain\u00a0name<\/h3>\n
                    Create Route 53 A\u00a0record<\/h3>\n
                    \n
                    Attachment<\/figcaption><\/div>\n<\/figure>\n
                    Configure ACM certificate in N. Virginia region .example.com<\/h3>\n
                    Create s3 bucket with website feature to host static\u00a0files<\/h3>\n
                    Create s3 bucket for avatars\/artworks<\/em><\/p>\n
                    \n
                    Attachment<\/figcaption><\/div>\n<\/figure>\n
                    Create Cloudfront distribution and attach ACM cert to\u00a0it<\/h3>\n
                    Create Cognito User\u00a0Pool<\/h3>\n
                    Attach own domain to Cognito User\u00a0Pool<\/h3>\n
                    \n
                    Screenshot 2021-01-22 at 12.53.03<\/figcaption><\/div>\n<\/figure>\n
                    Inside Cognito User Pool create web app client and Configure redirect\u00a0URL<\/h3>\n
                    Create Lambda \u00a0signup post confirmation trigger Function it will fetch user image from google\/fb<\/h3>\n
                    It may seem obvious but lambda has to have permission to s3\/dynamodb<\/h3>\n
                    Create API Gateway REST API with Lambda as\u00a0handler<\/h3>\n
                    don\u2019t forget to enable CORS, attach custom\u00a0domain<\/h3>\n
                    \n
                    Attachment<\/figcaption><\/div>\n<\/figure>\n
                    Create dynamodb users table with sub as partition key<\/h3>\n
                    export type User = {  username: string  date_joined: Date  first_name: string  last_name: string  city: string  country: string  description: string  email: string  track_count: number  avatar_url: string  permalink: string}<\/code><\/pre>\n
                    Create API Gateway Authorizer<\/h3>\n
                    \n
                    Attachment<\/figcaption><\/div>\n<\/figure>\n
                    Create Usage\u00a0plan<\/h3>\n
                    Create Stage<\/h3>\n
                    To enable logging you must create IAM\u00a0role<\/h3>\n
                    why did I choose DynamoDB: for example facebook users tend to read but not to post. Keep data ready to read = writing could be more complex<\/em><\/p>\n
                    API GW\u200a\u2014\u200aUse id_token, assign api key, usage plan, custom domain path mapping<\/em><\/strong><\/p>\n
                    Attach authorizer to appropriate endpoints<\/em><\/p>\n
                    \n
                    Attachment<\/figcaption><\/div>\n<\/figure>\n
                    \n
                    Attachment<\/figcaption><\/div>\n<\/figure>\n
                    Create user pool trigger on Post confirmation event to store user in db\u00a0<\/em>!!!<\/em><\/strong><\/p>\n
                    \n
                    Attachment<\/figcaption><\/div>\n<\/figure>\n
                    Build FFmpeg with dumpwave-filter patch applied or use prepared lambda package humeniukd\/ffmpeg-lambda.<\/em><\/p>\n
                    Create two s3 buckets first for incoming audio and second for storing processed mp3 along with json.<\/em><\/p>\n
                    For incoming bucket setup trigger for PUT event to execute wf-lambda function.<\/em><\/p>\n
                    Upload policy endpoint for generating presigned s3 url to PUT\/POST new uploads<\/em><\/p>\n
                    After processing of the track is finished successfully we send message to dedicated fifo queue. Outdated tracks(now\u200a\u2014\u200acreated_at < [reasonable time delta] AND status == \u2018preparing\u2019) deleted.<\/h3>\n
                    Create ES domain. Attach policy to access Kibana(in our case from ext acc lambda and from local\u00a0ip):<\/h3>\n
                    {  \"Version\": \"2012\u201310\u201317\",  \"Statement\": [    {      \"Effect\": \"Allow\",      \"Principal\": {        \"AWS\": \"arn:aws:iam::HIDDEN:role\/yes\"      },      \"Action\": \"es:\",      \"Resource\": \"arn:aws:es:eu-central-1: HIDDEN:domain\/ohyo\/\"    },    {      \"Effect\": \"Allow\",      \"Principal\": {        \"AWS\": \"\"      },      \"Action\": \"es:\",      \"Resource\": \"arn:aws:es:eu-central-1: HIDDEN:domain\/ohyo\/*\",      \"Condition\": {        \"IpAddress\": {          \"aws:SourceIp\": \"AA.BB.CC.DD\"        }      }    }  ]}<\/code><\/pre>\n
                    Create mapping for tags autocomplete suggested<\/p>\n
                    \n
                    Screenshot 2021-01-22 at 10.52.53<\/figcaption><\/div>\n<\/figure>\n
                    Put tags to new index<\/p>\n
                    \n
                    Screenshot 2021-01-22 at 10.54.06<\/figcaption><\/div>\n<\/figure>\n
                    Create endpoint to retrieve tags for autocompletion<\/p>\n
                    \n
                    Screenshot 2021-01-22 at 22.30.45<\/figcaption><\/div>\n<\/figure>\n
                    Create endpoint to save track metadata<\/p>\n
                    Create endpoint to resolve track\/user by permalink<\/p>\n
                    To respond with status 404 lambda should throw Error with message text recognised by API Gateway:<\/p>\n
                    \n
                    Screenshot 2021-01-31 at 15.39.25<\/figcaption><\/div>\n<\/figure>\n
                    -Put item to dynamodb(update user)<\/p>\n
                    Export API as swagger JSON<\/p>\n
                    \n
                    Screenshot 2021-02-09 at 22.06.20<\/figcaption><\/div>\n<\/figure>\n
                    Generate types on the FE side using yarn generate:types<\/p>\n
                    \n
                    Screenshot 2021-02-09 at 22.10.05<\/figcaption><\/div>\n<\/figure>\n
                    -Refresh ES index for search<\/p>\n
                    Configure api gateway template mapping for skipping empty fields<\/p>\n
                    Create user stream pagination using user_id as partition key and created_at as sort key<\/p>\n
                    If LastEvaluatedKey is present use it for next url query params<\/p>\n
                    Set up dynamodb stream to process newly created comments<\/p>\n
                    To POST artwork img configure api to accept encodings such as<\/p>\n
                    \n
                    Screenshot 2021-02-25 at 15.15.17<\/figcaption><\/div>\n<\/figure>\n
                      \n
                    1. \n
                      Go to the API Gateway settings tab for your API and add multipart\/form-data, image\/jpeg to the\u00a0binary media types<\/em>section.<\/p>\n<\/li>\n
                    2. \n
                      Add Content-Type and Accept to the request headers for your proxy method<\/p>\n<\/li>\n
                    3. \n
                      Add Access-Control-Allow-Methods to Method Response headers<\/p>\n<\/li>\n
                    4. \n
                      Re-deploy the API<\/p>\n<\/li>\n<\/ol>\n<\/div>\n<\/div>\n<\/div>\n
                      <\/div>\n

                       \u0441\u0441\u044b\u043b\u043a\u0430 \u043d\u0430 \u043e\u0440\u0438\u0433\u0438\u043d\u0430\u043b \u0441\u0442\u0430\u0442\u044c\u0438  https:\/\/habr.com\/ru\/articles\/752650\/<\/a>
                      <\/br><\/br><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[],"tags":[],"class_list":["post-351322","post","type-post","status-publish","format-standard","hentry"],"_links":{"self":[{"href":"https:\/\/savepearlharbor.com\/index.php?rest_route=\/wp\/v2\/posts\/351322","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/savepearlharbor.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/savepearlharbor.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/savepearlharbor.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/savepearlharbor.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=351322"}],"version-history":[{"count":0,"href":"https:\/\/savepearlharbor.com\/index.php?rest_route=\/wp\/v2\/posts\/351322\/revisions"}],"wp:attachment":[{"href":"https:\/\/savepearlharbor.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=351322"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/savepearlharbor.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=351322"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/savepearlharbor.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=351322"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}