Auto-Embed Links (formerly TikTok Plugin) [2024.03.06]

[lordroel]

Nov 8, 2024 22:29:59 GMT -8 Chris said:

Nov 8, 2024 12:06:46 GMT -8 lordroel said:

Seems that is the same for me.

I won't invest any more of my time into this then.

Okay, then i will wait until, and i hope a new version comes as it keeps working and then only showing a link and working again.

[bigballofyarn]

Nov 8, 2024 22:29:59 GMT -8 Chris said:

Nov 8, 2024 12:06:46 GMT -8 lordroel said:

Seems that is the same for me.

I won't invest any more of my time into this then.

Was anything added to the beta version other than the discovery feature? I'm fine with using the old version without the discovery feature. With the disclaimer that was listed on the discovery feature, I wasn't going to enable it anyway.  

[Chris]

Nov 9, 2024 4:07:31 GMT -8 bigballofyarn said:

Was anything added to the beta version other than the discovery feature? I'm fine with using the old version without the discovery feature. With the disclaimer that was listed on the discovery feature, I wasn't going to enable it anyway.  

/*  *** History Log ***
 *	v0.2.1.beta
- filtered out in-post links that do not use http or https
[BUG FIX]
- prevented jQuery from cache busting script tags (e.g. reddit did not like)
[BUG FIX]

 *	v0.2.0.beta
- added discovery for sites not in providers list or in plugin settings
[ENHANCE]
- added support for links with name="oembed" to trigger discovery if not in providers list or in plugin settings.
[ENHANCE]

 * 	v0.1.1.beta
- added support for {format} in endpoint url
[BUG FIX]
- cache downloaded provider list
[ENHANCE]

	v0.1.0.alpha
- added CORS proxy list for fallback support
[ENHANCE]
- Use CORS proxies to dynamically obtain fresh provider list
[ENHANCE]
- Improved flexibility in HTTP response handling
[BUG FIX]
- Made iframes optional
[SECURITY]

*/

[bigballofyarn]

Nov 9, 2024 6:07:51 GMT -8 Chris said:

Nov 9, 2024 4:07:31 GMT -8 bigballofyarn said:

Was anything added to the beta version other than the discovery feature? I'm fine with using the old version without the discovery feature. With the disclaimer that was listed on the discovery feature, I wasn't going to enable it anyway.  

/*  *** History Log ***
 *	v0.2.1.beta
- filtered out in-post links that do not use http or https
[BUG FIX]
- prevented jQuery from cache busting script tags (e.g. reddit did not like)
[BUG FIX]

 *	v0.2.0.beta
- added discovery for sites not in providers list or in plugin settings
[ENHANCE]
- added support for links with name="oembed" to trigger discovery if not in providers list or in plugin settings.
[ENHANCE]

 * 	v0.1.1.beta
- added support for {format} in endpoint url
[BUG FIX]
- cache downloaded provider list
[ENHANCE]

	v0.1.0.alpha
- added CORS proxy list for fallback support
[ENHANCE]
- Use CORS proxies to dynamically obtain fresh provider list
[ENHANCE]
- Improved flexibility in HTTP response handling
[BUG FIX]
- Made iframes optional
[SECURITY]

*/

If your plan is to not invest any time in this plugin at all, that is fine. I will respect your decision. However, as offered earlier, if you have the time and desire, I can install the one that's not working for some of us, and you can live test it on my forum. There is no obligation or pressure. I don't mind either way.

[Chris]

For those who wanted Bluesky to work in the older version, here is the entry from an updated provider list

{
       "provider_name": "Bluesky Social",
       "provider_url": "https://bsky.app",
       "endpoints": [
           {
               "schemes": [
                   "https://bsky.app/profile/*/post/*"
               ],
               "url": "https://embed.bsky.app/oembed",
               "discovery": true
           }
       ]
   }

You should be able to add it to the manual list by placing the schemes into the scheme column and the URL into the endpoint column.
(I have not tested if Bluesky requires one of the bug fixes or enhancements implemented in later versions).

---

For Reddit embeds, it requires at least one of the bug fixes to render correctly but it may still half-work

{
       "provider_name": "Reddit",
       "provider_url": "https://reddit.com/",
       "endpoints": [
           {
               "schemes": [
                   "https://reddit.com/r/*/comments/*/*",
                   "https://www.reddit.com/r/*/comments/*/*"
               ],
               "url": "https://www.reddit.com/oembed"
           }
       ]
   }
One scheme per manual entry, so Reddit offers two schemes (one with www and one without) with the endpoint url remaining the same for both schemes.

[recycledferret]

Nov 9, 2024 6:39:20 GMT -8 Chris said:

For those who wanted Bluesky to work in the older version, here is the entry from an updated provider list

{
       "provider_name": "Bluesky Social",
       "provider_url": "https://bsky.app",
       "endpoints": [
           {
               "schemes": [
                   "https://bsky.app/profile/*/post/*"
               ],
               "url": "https://embed.bsky.app/oembed",
               "discovery": true
           }
       ]
   }

You should be able to add it to the manual list by placing the schemes into the scheme column and the URL into the endpoint column.
(I have not tested if Bluesky requires one of the bug fixes or enhancements implemented in later versions).

---

For Reddit embeds, it requires at least one of the bug fixes to render correctly but it may still half-work

{
       "provider_name": "Reddit",
       "provider_url": "https://reddit.com/",
       "endpoints": [
           {
               "schemes": [
                   "https://reddit.com/r/*/comments/*/*",
                   "https://www.reddit.com/r/*/comments/*/*"
               ],
               "url": "https://www.reddit.com/oembed"
           }
       ]
   }
One scheme per manual entry, so Reddit offers two schemes (one with www and one without) with the endpoint url remaining the same for both schemes.

What about reddit gallery posts. This only works on texts posts but not picture posts.

Can Amazon links be added?

[Chris]

Nov 9, 2024 15:43:00 GMT -8 recycledferret said:

What about reddit gallery posts. This only works on texts posts but not picture posts.

Can Amazon links be added?

Oct 18, 2023 23:30:28 GMT -8 Chris said:

This update incorporates the list of oEmbed providers maintained at oembed.com/providers.json.

Mar 1, 2024 17:39:21 GMT -8 Chris said:

The update uses the list of Oembed providers maintained at oembed.com/providers.json. If you want to verify link structure you can take a look at the accepted schemes provided for each site.

Nov 9, 2024 6:39:20 GMT -8 Chris said:

For those who wanted Bluesky to work in the older version, here is the entry from an updated provider list

SPOILER: Click to show

There

SPOILER: Click to show

is

SPOILER: Click to show

no

SPOILER: Click to show

entry

SPOILER: Click to show

in

SPOILER: Click to show

the

SPOILER: Click to show

list

SPOILER: Click to show

at

SPOILER: Click to show

[oembed.com/providers.json]

SPOILER: Click to show

for

SPOILER: Click to show

amazon

SPOILER: Click to show

...

SPOILER: Click to show

SPOILER: Click to show

Jul 22, 2019 2:41:56 GMT -8 Chris said:

I also noticed that regular members are posting ads not just staff on that forum so the plugin in this post might be a better fit since it restricts based on allowed domains and what they are permitted to do rather than who is the author of the post. It employs sandboxed iframes to finetune what a domain is ultimately permitted to do on the forum and protect from malicious players.

Add "ws-na.amazon-adsystem.com" for example so your members can then post ads from that domain

To post they can then add an anchor with name="embed" to the post which will be converted to an iframe provided it is in the allowed list you created in the plugin

[recycledferret]

Nov 10, 2024 8:14:45 GMT -8 Chris said:

Nov 9, 2024 15:43:00 GMT -8 recycledferret said:

What about reddit gallery posts. This only works on texts posts but not picture posts.

Can Amazon links be added?

Oct 18, 2023 23:30:28 GMT -8 Chris said:

This update incorporates the list of oEmbed providers maintained at oembed.com/providers.json.

Mar 1, 2024 17:39:21 GMT -8 Chris said:

The update uses the list of Oembed providers maintained at oembed.com/providers.json. If you want to verify link structure you can take a look at the accepted schemes provided for each site.

Nov 9, 2024 6:39:20 GMT -8 Chris said:

For those who wanted Bluesky to work in the older version, here is the entry from an updated provider list

SPOILER: Click to show

There

SPOILER: Click to show

is

SPOILER: Click to show

no

SPOILER: Click to show

entry

SPOILER: Click to show

in

SPOILER: Click to show

the

SPOILER: Click to show

list

SPOILER: Click to show

at

SPOILER: Click to show

[oembed.com/providers.json]

SPOILER: Click to show

for

SPOILER: Click to show

amazon

SPOILER: Click to show

...

SPOILER: Click to show

SPOILER: Click to show

Jul 22, 2019 2:41:56 GMT -8 Chris said:

I also noticed that regular members are posting ads not just staff on that forum so the plugin in this post might be a better fit since it restricts based on allowed domains and what they are permitted to do rather than who is the author of the post. It employs sandboxed iframes to finetune what a domain is ultimately permitted to do on the forum and protect from malicious players.

Add "ws-na.amazon-adsystem.com" for example so your members can then post ads from that domain

To post they can then add an anchor with name="embed" to the post which will be converted to an iframe provided it is in the allowed list you created in the plugin

OK but the new version doesn't work

Everything Just shows up as the word link. There are no embeds

[Chris]

Nov 10, 2024 18:15:35 GMT -8 recycledferret said:

OK but the new version doesn't work

Everything Just shows up as the word link. There are no embeds

Yeah you said that already but you are not willing to lift a finger to help fix it so...

Stoicism said: Key points: 1. Do not help ungrateful person 2. Lazy people 3. Irresponsible person 4. Manipulators 5. Chronic critics 6. Narcissists 7. Opportunists 8. Envious individuals

Nov 11, 2024 6:30:49 GMT -8 Chris said:

[bigballofyarn]

Chris,

Do you want me to install the beta one on my forum and we can test together? What can I do to help get this resolved for everyone?

[Chris]

bigballofyarn , thank you.
Unfortunately, my expected free time had to be delayed once again

I appreciate you 

Stoicism said: Key points: 1. Do not help ungrateful person 2. Lazy people 3. Irresponsible person 4. Manipulators 5. Chronic critics 6. Narcissists 7. Opportunists 8. Envious individuals

[bigballofyarn]

Chris,
No worries. If/when you are available, we can hopefully coordinate a time when we're both free.

For anyone else stating that the newest version "doesn't work," I'd encourage you to be more detailed. For me personally, all previous embeds stopped embedding, no future posts were embedded, the "check embed" button was gone, and anything new that was previously able to be embedded appeared as the word "link." There are various factors that could be at play, including user error. Plugins that my boyfriend and I created, or another plugin entirely could be interacting with the new one. Every forum may have a different issue, but the more specific you are with the problems and expectations you have, the easier they will be to resolve.

[Chris]

We've already established that v0.2.1 is broken when it attempts to download a new provider list. The browser's security heuristics, in an abundance of caution, deny the download because the "content-type" of what was requested does not match the type that was actually sent. The plugin's coding expects a "success" or a "failure" but not a "successfully failed" and therefore crashes hard.

ETA3: v0.2.2 (changes below applied )()

ETA2: This is just a band-aid since it does not address the root cause, but it should allow v0.2.1 to continue parsing after the download gets rejected instead of aborting.

1. Click the Build Plugin button to enter build mode

   
   
   

2. Go to the components tab and then scroll down to line 25 in the 2nd javascript component and you should see this

   if(localStorage['oEmbed_providers'] && (+new Date - +new Date(Number(localStorage['oEmbed_providers_time']))) <  parseInt(settings.update_on,10) ){
settings.providers = JSON.parse(localStorage['oEmbed_providers']);
console.info(`Grabbed provider list from localStorage with ${settings.providers.length} entries (static list has ${p.length} entries)`)
}else{

   
   
   edit it to add try/catch so it can recover from any possible network errors returning HTTP errors in HTML instead of JSON
   
   

   if(localStorage['oEmbed_providers'] && (+new Date - +new Date(Number(localStorage['oEmbed_providers_time']))) <  parseInt(settings.update_on,10) ){
try{ //start try/catch
settings.providers = JSON.parse(localStorage['oEmbed_providers']);
console.info(`Grabbed provider list from localStorage with ${settings.providers.length} entries (static list has ${p.length} entries)`)
}catch(k){} //end try/catch
}else{

   
   
   

3. Go to the components tab and then scroll down to line 42 in the 2nd javascript component and you should see this

   if(providers.length){ console.log(Array.from(content.headers.entries())); //debugger;

settings.providers = providers;
localStorage['oEmbed_providers']= JSON.stringify(providers);
localStorage['oEmbed_providers_time']= +new Date;
console.info(`Successfully downloaded provider list from ${provider.url} with ${settings.providers.length} entries, older (default) list had ${p.length} entries`)
}

   
   
   edit it to add try/catch so it can recover from any possible network errors returning HTTP errors in HTML instead of JSON
   
   

   if(providers.length){ console.log(Array.from(content.headers.entries())); //debugger;
try{ //start try/catch
localStorage['oEmbed_providers']= JSON.stringify(providers);
localStorage['oEmbed_providers_time']= +new Date;
settings.providers = providers;
console.info(`Successfully downloaded provider list from ${provider.url} with ${settings.providers.length} entries, older (default) list had ${p.length} entries`)
}catch(k){} //end try/catch
}

   
   
   

4. You'll need to manually add newer additions to the provider list if the plugin cannot download the list

   
   
   

ETA: instructions on how to create a free and private Cloudflare proxy
(this proxy removes the content-type in the response, preventing the browser from suspecting it as an attempt at an exploit)

[recycledferret]

Where do you sign up

Here?

dash.cloudflare.com/sign-up/

??

[bigballofyarn]

Nov 13, 2024 1:27:08 GMT -8 Chris said:

We've already established that v0.2.1 is broken when it attempts to download a new provider list. The browser's security heuristics, in an abundance of caution, deny the download because the "content-type" of what was requested does not match the type that was actually sent. The plugin's coding expects a "success" or a "failure" but not a "successfully failed" and therefore crashes hard.

ETA: instructions on how to create a free and private Cloudflare proxy

All is good. This is fine for me. I'm never putting you to work. The objective was only to offer you help if what you wanted to do was test/code/whatever. I'm keeping the older one installed for now and may play around with Cloudflare when I have more time later. I expect that my forum would reach 100,000 hits entirely too quickly though. With that, I might just keep the older version of the plugin and not even bother with Cloudflare. Your coding, help, and generosity never go unnoticed.