Xaquseg 714 followers

Xaquseg is the system administrator for FIMFiction, as well as various misc. development, especially related to security. Non-technical problems are probably best asked to other staff members.

News Archive

  • 200 weeks
    Downtime & Server Move

    Hi all. Firstly, apologies for the extended period of unexpected downtime. Obviously any kind of downtime is non ideal, but unexpected is more annoying all around.

    On Friday morning (GMT) we experienced a hardware failure on our database server. To our knowledge there is no data loss of any kind. We have fairly regular backups hosted off-site, regardless. The exact cause isn't entirely clear at this time, but instead of wrestling with trying to get the hardware sorted (it was a dedicated server) we decided that this was a good opportunity to make a server move we've been planning for a long time over to Digital Ocean.

    Read More

    236 comments · 15,370 views
  • 277 weeks
    BBCode updates

    Performance improvements

    Over the last few days I've been working on improving the performance of the BBCode parser. I've managed to implement a few major optimizations, reducing the run time in common cases to around 1/4th to 1/20th compared to the older version. This has reduced total server-side render times on some of the more complicated test pages I've been using to around 50ms–70ms, which should be a noticeable improvement.

    New features

    Opacity

    Read More

    49 comments · 4,892 views
  • 300 weeks
    Recent Changelog

    We've done various unannounced changes of the past few weeks so I thought I'd group up the things we've done so you guys know what's changed.

    • Added account linking page for Patreon / Twitter
    • Added ability to cross post stories, blogs and bookshelf additions to Twitter
    • Added twitter userpage module
    • Added account deletion page
    • Reorganised user toolbar dropdown to better fit more items
    • Added session management page to see logins and active sessions on your account
    • Added new articles system and moved some existing ones into it
    • Redesigned PM page a bit to be cleaner
    • Increased font size in major places across the site to improve readability
    • New cookie consent controls for EU users and updated privacy policy
    • Recommended groups list on groups page - WIP
    • Tooltips in many locations around the site with helpful tips

    Read More

    114 comments · 6,019 views
  • 301 weeks
    Help Articles

    Something I've worked on the last couple of days is adding the ability for us to add arbitrary "articles" to the site which we can use for various things. Sort of an extension on the manual articles we've added in the past like the bbcode page, writing guide, etc.

    So far I've added 3 guides:

    I'd love to know if you guys have any idea for articles that would have helped you out when starting out or anything else that comes to mind.

    65 comments · 5,179 views
  • 328 weeks
    Night Mode

    I've been working on it for ages but only really got the impetus to finish all of it off over the last few days. In the "settings" dropdown at the top on desktop, or the bottom of the slide out bar on mobile you'll find a toggle for night mode. Enjoy!

    Oh, and although I've tried to cover everything there is a 100% chance I've missed styling some things so apologies in advance for any funky pages.

    246 comments · 6,794 views
  • 329 weeks
    Additional Search Update

    Hey folks,

    Over the last few days I've added a few things to the new search system. A lot of people were unhappy with not being able to filter various things as quickly as they used to be able to. To that end, I've added a little filter dropdown to the right of the search box which effectively contains everything the old sidebar used to. It even has some niceties like quick word count filters and a highly rated filter.

    Read More

    132 comments · 5,298 views
  • 330 weeks
    December 2017 Update

    Hey guys, got a whole bunch of updates for you today.

    Tags

    This is a small but important step on our way to the tagging system I envision. The existing way we handled things like characters and genres has all been merged into a single tagging system. That won't result in much difference for you viewing and using the site but it makes it a lot easier to add new tags especially.

    We now have a couple of new tag types: series and warnings.

    The series tag is for identifying what series (franchise) your fanfiction contains. I've added a whole ton of various TV shows, movies, comics, books and games but clearly we will have to add a ton more in the coming future. Stories must also contain one of the four MLP tags which are FIM, EqG, Movie and Comic, as this is a pony fanfic site after all. Feel free to bug me on Discord if you have a requirement for a series to be added.

    Read More

    630 comments · 13,770 views
  • 330 weeks
    Math BBCode tag

    I've added [math] and [mathblock] BBCode tags, which can be used to display formatted math. We've had a few requests for this, particularly for group forum threads and blog posts. Most math-related TeX syntax is supported. (We are currently using MathJax to handle the layout.)

    The documentation from the BBCode guide is repeated below for your convenience.

    Read More

    84 comments · 4,408 views
  • 353 weeks
    Fimfiction API

    If you're not a developer you can probably ignore this post.

    It's been like 6 years, but hey, things take time. The API is currently very WIP still but it's ready for people to get working on in our development chat room.

    API documentation can be found at https://www.fimfiction.net/developers/api/v2/docs and you should join the Discord Chat and PM me to add you to the private API channel and I can help you get started. The functionality is very limited right now but I'm dedicating all my time to it at the moment and would love to have people add their input to the process.

    60 comments · 7,397 views
  • 358 weeks
    New BBCode Tags

    Hey guys,

    One of the features in this new update was reader-side paragraph formatting. This helps improve consistency for readers across the site, especially for those of us who can’t stand reading indented text on a computer screen.

    However, one thing that wasn’t accounted for was the legitimate need for specific indenting of passages and for certain blocks of text to have no paragraph formatting. Some examples would be lyrics and poetry.

    Taking this into account, we have come up with a couple of new tags that remedy this situation which are documented below (copied directly from the bbcode guide)


    [indent] Indent

    The indent tag can be used to, unsurprisingly, indent portions of your text.

    [indent]The indent tag can be used to, unsurprisingly, indent portions of your text.[/indent]

    It also support levels of indenting

    Read More

    168 comments · 6,392 views
Feb
7th
2016

Site Update » Imgur problems · 5:23am Feb 7th, 2016

Imgur has blacklisted us for image embeds, stating that they do not allow images on their service to be used as content on other websites. Their ToS seems to confirm this, stating:

Also, don't use Imgur to host image libraries you link to from elsewhere, content for your website, advertising, avatars, or anything else that turns us into your content delivery network.

This apparently applies to users uploading images to post on other websites (including this one, and I would have to assume most others), which we were not previously aware of. Unfortunately I do not have a recommendation of an alternative site for users to host images they need to embed on our site or elsewhere.

They do have an official embed function, however is highly limited and incompatible with various aspects of our code due to requiring a <script> embed that is both a security risk and makes certain assumptions about how the page being embedded on works, which don't hold up on our site. I cannot find a functional <iframe> embed solution, so for the moment I have no workaround that will allow the image to appear on the page or behind an expand button. I'm not sure that we can use their embed under their ToS anyway...

You should still be able to link to the gallery page if you need to share an Imgur image on-site, however it is unclear exactly how their ToS applies in that situation, so it's possible they will block that too at some point.

For users that need to include images in their story, we should be able to offer an image upload function that will enable this soon, however as this could potentially be a large number of images we need to make sure that everything is properly ready before we enable such a feature. Unfortunately I cannot promise any particular date, but hopefully it won't be too complicated to setup.

Report Xaquseg · 12,039 views ·
Comments ( 222 )
Meeester
Moderator

Time to go back to Imageshack. Oh wait...

I switched all the images in my stories to imgbox. Seems to be working well enough so far.

Imgur has blacklisted us for image embeds,

[sarcasm]Awesome.[/sarcasm]

Good thing I've got a DeviantArt page, too.

3738112
Time to use Google Image search for image hosting!

And that's why I use Photobucket.

I wish there was a way we could just upload a picture instead if having to do a url.

I think a local image hosting solution would be good; perhaps you could make a script that goes through stories that have embedded images in them/popular stories, and offers the feature to those authors for beta testing so you don't get flooded

Huh.

Go figure.

~Skeeter The Lurker

Emtu #9 · Feb 7th, 2016 · · ·

That seems to mean as part of the website's layout, which I assume some people were doing as custom dividers and such, not for just uploading and embedding a single image on a single page.

Edit: The key word in that bit of their ToS you quoted is libraries.

we should be able to offer an image upload function that will enable this soon,

Okay, that'll be cool.

however as this could potentially be a large number of images we need to make sure that everything is properly ready before we enable such a feature.

I can easily wait for that. :twilightsmile:

Damn, now I have to go through my blogs...

don't use Imgur to host image libraries you link to from elsewhere

Implying that there are other uses for image upload and storage services? :trixieshiftleft:

Snark aside, what about Picasa? The Picasa web function does allow you to generate both direct links and embed code snippets for an image.

I have faith in you.
3738112
I'm interested to hear the story behind that, if there is one. Keep up the good work.

D48
D48 #14 · Feb 7th, 2016 · · ·

...So basically they want people to use other sites to host images? That seems kinda counterproductive to me.

Xaquseg
Server Administrator

3738120
The thing is they don't really define that, and having, say, a couple standard reaction images you host on imgur and reuse could easily be considered a small library of reaction images.

Imgur does have heavy traffic daily, I would see why this happened. Wonder how the local upload will do to the fimfic servers, hope the load on servers doesn't get too high ^^

Nines #17 · Feb 7th, 2016 · · 1 ·

I've used photobucket.com for years. No complaints!

Well, that explains my situation.:ajbemused:

3738127
That's probably not the intended meaning but it could be interpreted that way. You could ask them exactly why FimFic got blacklisted. (Like, what images linked from where.)

3738123 I asked Deviant Art, they are perfectly find with you embedding images elsewhere that are uploaded to their site.

archonix #21 · Feb 7th, 2016 · · 2 ·

so basically they've taken the thing that made them popular and said "we don't like this any more", and fuck everyone.

TinyPic may work for some, it's worth a try.

Google Drive and MediaFire both have pretty good picture embedding.

3738116
3738129
Thirding photobucket. I know it's so last decade, but it seems to work pretty well.

Xaquseg
Server Administrator

3738128
We already serve an enormous number of images for story cover art and user avatars, so theoretically in-story image uploads shouldn't be too bad percentage wise. However we do have to make sure that users aren't allowed to upload thousands of images and take up enormous amounts of space on our systems, and it'll take a bit of time to build the upload UI and test it, so don't expect the feature to be ready immediately.

A direct upload to FimFic that'd allow users to eliminate the second party host like Imgur would be really handy. Although, I don't know what that would do for bandwidth since that's why knighty got rid of the banners(?)

Pity, really.

For users that need to include images in their story, we should be able to offer an image upload function that will enable this soon, however as this could potentially be a large number of images we need to make sure that everything is properly ready before we enable such a feature. Unfortunately I cannot promise any particular date, but hopefully it won't be too complicated to setup.

This could make having huge hard drives a necessity for the site, considering the size difference between text and image files.

3738117

Xaquseg:
For users that need to include images in their story, we should be able to offer an image upload function that will enable this soon,

ankyo #28 · Feb 7th, 2016 · · 1 ·

I was able to use a chrome extension called "Referer Control" (the one with the most ratings) to get around the issue on my end.

3738142

I believe the reason that he got rid of the banners is that they were all MLP-based, and he's planning on reworking the site to be a generic fanfiction site.

What's the point of Imgur, then?
They clearly don't want people using it.

3738144 I'm not a tech person. I didn't understand half of what they were talking about. :twilightblush:

…or anything else that turns us into your content delivery network

As if Imgur wasn't started with the express purpose of being a content delivery network for Reddit… Ugh. Such nonsense. :facehoof:

I mostly use Dropbox when I need to link things, but they've since phased out public folders completely, so I guess I can't recommend that…

I just use the deviantart sta.sh function. It's basically one great big private image storage site.

Hm.

Maybe one could use Gyazo for the time being?

Wouldn't be the best, but it'd be at least something...

~Skeeter The Lurker

3738140 Alright then, so it will just be in the fimfic CDN? Are you also thinking about removing any old image files, if there are any

Yeesh. Thanks for dealing with the nuts and bolts of keeping the ponyfics flowing.

I use dropbox for the occasional image, so far without incident. As far as I can tell it's against their TOS

Welp, bye bye imgur. It was fun while it lasted.

Thanks for keeping us updated.

Oh well, time to switch all my direct links over to TinyPic. Considering the amount of pictures I have, that'll be quite the task.

May as well start using Derpibooru in this case.

ive never used imgur i always use tinypic for uploading images

3738146

I believe the reason that he got rid of the banners is that they were all MLP-based, and he's planning on reworking the site to be a generic fanfiction site.

Fimfiction.net will never be anything else. Knighty is planning on having a second site attached to the same backend with different branding for the generic fiction site.

Well shit. This explains a lot. :trixieshiftleft:

3738113
I'll definitely be switching all the pictures I use online over to imgbox.

I use postimg.org. They're what Image Shack and Photobucket used to be before they over-complicated the plumbing. They're free, too.

Xaquseg
Server Administrator

3738144
We already deal with a fairly large amount of image data for user avatars and story cover art. Ignoring cost-related problems, we could easily handle many terabytes worth of images under our current configuration. The costs, however, are a potential issue and I want to make sure that the limits are set well enough that they don't become one.

3738134 Ah, okay. Thanks for looking into that! Def a good option to consider. :)

FYI, one can fix it locally by preventing one's browser from sending a referer header to i.imgur.com. (I use Firefox with RefControl installed; this works for me.)

due to requiring a <script> embed that is both a security risk and makes certain assumptions about

I'm having flashbacks to that time that guy embedded a ton of images on our userpages.

there goes the only way I can share photos on my mobile devices...

So Imgur basically just ruined it's entire purpose.

Login or register to comment