Skip to content

Commit

Permalink
handle BLEXBot (WebMeUp)
Browse files Browse the repository at this point in the history
  • Loading branch information
gabrieljablonski committed Sep 19, 2024
1 parent b4d6dce commit 6d71cf2
Show file tree
Hide file tree
Showing 5 changed files with 80 additions and 0 deletions.
1 change: 1 addition & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -54,6 +54,7 @@ end
- [Applebot](https://support.apple.com/en-us/119829)
- [Baidu spider](http://help.baidu.com/question?prod_en=master&class=498&id=1000973)
- [Bingbot](https://blogs.bing.com/webmaster/2012/08/31/how-to-verify-that-bingbot-is-bingbot/)
- [BLEXBot (WebMeUp)](http://webmeup-crawler.com/)
- [DuckDuckGo bot](https://duckduckgo.com/duckduckbot)
- [Google crawlers](https://support.google.com/webmasters/answer/1061943)
- [IAS](https://integralads.com/ias-privacy-data-management/policies/site-indexing-policy/)
Expand Down
1 change: 1 addition & 0 deletions lib/legitbot.rb
Original file line number Diff line number Diff line change
Expand Up @@ -8,6 +8,7 @@
require_relative 'legitbot/apple'
require_relative 'legitbot/baidu'
require_relative 'legitbot/bing'
require_relative 'legitbot/blexbot'
require_relative 'legitbot/duckduckgo'
require_relative 'legitbot/facebook'
require_relative 'legitbot/google'
Expand Down
10 changes: 10 additions & 0 deletions lib/legitbot/blexbot.rb
Original file line number Diff line number Diff line change
@@ -0,0 +1,10 @@
# frozen_string_literal: true

module Legitbot # :nodoc:
# http://webmeup-crawler.com/
class BLEXBot < BotMatch
domains 'webmeup.com.'
end

rule Legitbot::BLEXBot, %w[BLEXBot]
end
60 changes: 60 additions & 0 deletions test/blexbot_test.rb
Original file line number Diff line number Diff line change
@@ -0,0 +1,60 @@
# frozen_string_literal: true

require_relative 'test_helper'

class BLEXBot < Minitest::Test
include Minitest::Hooks
include DnsServerMock

def test_malicious_ip
ip = '149.210.164.47'
match = Legitbot::BLEXBot.new ip

refute_predicate match, :valid?
end

def test_valid_ip
ip = '65.21.113.197'
match = Legitbot::BLEXBot.new ip

assert_predicate match, :valid?
end

def test_malicious_ua
bot = Legitbot.bot(
'Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webmeup-crawler.com/)',
'149.210.164.47'
)

assert bot
refute_predicate bot, :valid?
end

def test_valid_ua
bot = Legitbot.bot(
'Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webmeup-crawler.com/)',
'65.21.113.197'
)

assert bot
assert_predicate bot, :valid?
end

def test_valid_name
bot = Legitbot.bot(
'Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webmeup-crawler.com/)',
'65.21.113.197'
)

assert_equal :blexbot, bot.detected_as
end

def test_fake_name
bot = Legitbot.bot(
'Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webmeup-crawler.com/)',
'81.1.172.108'
)

assert_equal :blexbot, bot.detected_as
end
end
8 changes: 8 additions & 0 deletions test/lib/dns_server_mock.rb
Original file line number Diff line number Diff line change
Expand Up @@ -38,6 +38,14 @@
ptr: %w[17-58-98-60.applebot.apple.com]
},

# BLEXBot (WebMeUp)
'pot22.webmeup.com' => {
a: %w[65.21.113.197]
},
'65.21.113.197' => {
ptr: %w[pot22.webmeup.com]
},

# Google
'crawl-66-249-64-141.googlebot.com' => {
a: %w[66.249.64.141]
Expand Down

0 comments on commit 6d71cf2

Please sign in to comment.